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Abstract 



"Various aspects of the marking practices of 39 seeondsuc 7 
school teachers from two schools in Metropolitan Nashville- 
Davidson County, Tennessee were studied intensively* The Intact 
of a special in*servioe program on the assignment of marks was^ 
also investigated* 

Analysis of marks assigned by the teachers during the first 
semester of 1965-66 showed that average marks on quizses and 
daily work are hi^er than those assigned for six-week tests 
and that marks assigned for six-week periods are higher than 
those on semester exams* Despite these mean differences, there 
is great variability in the average marks of individual teachers 
on all types of classroom measures* The same general results 
were obtained for second semester data (following the in-service 
program) with the only difference being that average marks for 
all types of classroom measures are lower for the second semester* 

A positive correlation was found between average class marks 
and average class IQ for both semesters* Correlations between 
IQ and marks assigned by individual teachers vary from slightly 
negative to above *60* Individual differences in the magnitude 
of these correlations can be only partially accounted for by 
differences in range of ability from one class to the next* The 
relationships among mlBUPks for different six-week periods and the 
final semester exam tend to be Uniformly high Irreepeotive of the 
magnitude of the relationship between IQ and semester marks* This 
is true of the data for both aemeetere. 
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Variation In final semester marks is highly predlotable 






from marks 



assigned for six*week periods and the semester exam. 



The semester exam and third 8lx>Heek marks generally account 



ior Dior# variance than do marks for the first two six-week periods. 
However, there is great variation fr«n teacher to teacher in the 
relative laflportance of six week lAd semester exam mark?. 

Special Marking Exercises containing standard data on 



l^othetieal students wexw used to studf the map king practices 
of teachers under more uniform conditions than exist in the 
classroom. Inter-teacher agreement is generally high on these 
exercises although there is great variation in the marks assigned 
to specific students . The variance in marks assigned on these 
exercises is almost entirely accounted for by data in the exercises 
but the lag)ortanee of specific types of data tend to be determined 



. ... , *e 

largely by the statistical characteristics of the scores built 
into the exercises, e.g. a quls with large variability is more 
In^ortant than a major exam. This strongly suggests that teachers 



are largely u.»ware of the effects of differential variability In 
data with idiich they work. Also, the marking exercises reveal 
^that most teaohers Interpret numeric data in an absolute rather 
i than normative fashion. The In-service training had no apparent 
! liig)aet upon the marking practices oh the exercises. 



‘ Finally, the self-reported marking practices of the teaohers 
reflect great individual differences with respect to the basis 
for marking and the laqportanee attached to a multitude of factors 
considered in the assignment of marks. " No substantial changes in 
self-reported practices resultedi from the in-servlc® program.' 
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INTRODDCTION 






The assignment of marks to students is one of the most 
impcrtant responsibilities of the classroom teacher. The marks 
which a student receives Influence his life in several ways. 
First, marks are typically the only data which a student and . 
his parents regularly receive regarding his success in the 

I 

school setting. Harks are therefore the primary channal through . 

;tilch the student and his parents have an opportunity to assess 

• . • » 

the correspondence between actual performance and self* or 
parent al*in90sed aspirations. Second, marks are frequently 
enq[>loyed for adn^nlstrative action such as sectioning students . 

^ ' i ^ 

ixceordlng to ability^ selecting students for special recognition^, 
etc. The marks a- student receives can thereby be decisive in 
determining the nature of the future training and opportunities 
Which he receives within the school program. Finally, the marks 
a student receives have a tremendous bearing upon his future 
opportunities beyond the school setting. School marks have 




traditionally been one of the most in^ortant factors in eolle.se 

• • 

admissions and in the selection of personnel for various types 
of specialized training or enq>loyment. The use of marks for 

such purposes is becoming increasingly inqportant as more and more 

♦ • 

students seek admissions to college and more and more eDq>loyers 
require a secondary education of job appliccuits. There can be 
little^ doubt that marks are of considerable practical significance 
to a student when one recognizes the variety of ways in which the 
student's life is influenced by them. 
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jto sr '•O of the alnost universal use of marks In our 
schools and the crucial role which they play In shaping a students 
ruturo, relatively little research has been conducted recently on 
the actual process of assigning and reporting marks. The evidence 
which has been collected consistently Indicates that practices 
related to the assignment and reporting of marks are better 
characterised by diversity from one teacher to the neat and from 
one sch.,01 to the next than any standardisation of practices. 

See Roelfs (19W,j 1955). Jansen (I960) and Vronan. at. al. (1962). 
This general result ^olds for individual teachers within a 
specific subject matter and school as well as for teachers 
working In different sub jest smtters and different schools. 

Policies designed to decrease the. diversity of marking practices 
within a. school have alao been found to vary greatly from school 
to school. See Jansen (I960) and Terwllliger (196ft). The upshot 
is that marks assigned by ane beaeher barry.qadte dlffarsat 
meaning than do -thoBe -aaslghed- hy. anofaheJ* teacher,: even if both 
teachers teach the same subject at the same school. This Is 
clearly Illustrated in the results of a recent survey of ,tl.e 
marking practices of nearly ftooo secondary school teachers con- 
ducted by the writer. (Terwllliger, 1966) 
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These data, along with studies of the reliability of marks 
Starch and Elliot (1912; 1913); Johnson (1935); Morlan (1931), 
Dtoderlch, ot.^. (1961) present a rather dismal picture of the 
process of markl^ aa it la typlcrily done In the echoole. In 
spite of this, little reaearch has been conducted recently on 
the narking process. Just as significant as the lack of research 



















iMi&<rfWMi I itfum 

UlUlBEiattl 






1 



‘^4 









tMV.fi* II A 



.*li ••,«*»»■'. 






%; 

t 

p. 



1 .. 






>Wm 



3 



Is the manner in whf h the topic of marking is treated In 
textbooks on measurement and evaluation for teachers. An 
examination of several of the current texts reveals that only a 
few pages are typically devoted to marking and the topic is 
generally discussed from a very broad philosophical point of view. 
Little is offered in the way of concrete suggestions or specific 
criticisms of methods currently used by many classroom teachers. 

: This study attempts to answer several questions concerning 
the marking practices of secondary school teachers. These 
questions may be summarized as follows: 

(a) With respect to data from quizzes^ tests, homework, 

special projects, etc. 

(1) what is the difficulty level (mean score) and to 
what extent does this difficulty vary from teacher 
to teacher? 

(2) what is the discriminability (standard deviation) 
and to what extent does this vary from teacher to 
teacher? 

(3) what is the relative weight of each type of data 
(determined by multiple regression) in the assign- 
ment of marks and to what extent do these weights 
vary from teacher to teacher? 

(i|.) what is the relationship of stimdar^.i^ed test scores 
to these data and how does this vary from teacher to 
teacher? 



(b) With respect to final semester marks 






I 

ik' 



(1) what is the average mark assigned and how does this 
vary from teacher to teacher? 

(2) what is the variability in assigned marks and how 
does this vary from teacher to teacher? 

(3) ^at is the relative weight given to marks in 
previous marking periods and the final semester exam? 

(i|i) idiat is the relationship of standardized test scores 
to semester marks and how does it vary from teacher 
to toa'*'^er? 
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(c) 



(d) 



(o) 









With respect to the msu^ks assigned to a class of 20 
hypothetical students for which certain st^dard data 
are provided 



( 1 ) 



What is the rellahlllty of the marks ( lnter«teacher 
agreement) and to whet extent does this vary from 
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( 2 ) 



idiat is the relative weight of various types of 
data (quizzes 9 tests, homework, etc.) and how do 
these weights vary from teacher to teacher? 



An ^alysis of self-reported majt-king practices will also 
be made to check for systematic differences between 
subject matter areas and to compare data collected in 
this fashion with actual marking data based upon school 
records and the class of hypothetical students. 



A final major question of the study deals with the 
degree to which the marking practices of secondary 
teachers can be influenced by a concentrated in-service 
training program. This question will be answered by 
comparing actual school marks, marks assigned to 
hjrpothetical students, and self -reported marking practices 
after training with those obtained prior to the training, 
i.e. a repetition of the analyses described in (a), (b), 
(c), and (d) after special training. 
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GENERAL DESIGN 



Participating Schoola 

The project described in this report was undertaken to study 
intensively the process of student marking in two secondary school&i 
in Metropolitan Nashville ^Davidson County « Tennessee* The 
schools participating in this research were selected so as to 
represent different geographic end socio-economic cross-sec &lon3 
of the entire Metropolitan Nashv5'’le School System* Selected data 

9 • 

describing the two schools are presented in Table 1* 
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Table 1 : 

Selected Descriptive Data on /Uie Two Participating Schools 

School A School B 



Grade Levels 

Approximate 
Total Enrollment 

Total Faculty 

Age of Building 
in Years 

Percent of 1966 
Graduates College-Bound 

Socio-Economic Character- 
istics of District Served 



Number of Participating 
Teachers 






,ERJC^ 



7-12 

i5oo 

61 

6 

85 



I#' 



Middle to upper 
claspj predominantly 
upper-middle; father 
occupation primarily 
managerial or profes< 
sional; newer suburb* 
an area 



21 



7-12 

1600 

67 

36 

55 



Middle to upper- 
middle, predomi- 
nantly middle; 
father occupation 
primarily mana- 
gerial or small 
business; older 
established resi- 
dential area 

I 

18 
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The principals of the two schools were contacted during the 
latter half of the first semester of the 1965-66 school yeai'. 

At that time, the general objectives of the research were discussed 
and the proposed study was outlined in detail. Each principal, 
in turn, discussed the project with members of his faculty and 
obtatoed their cooperation as participants in the study. 
PartlclPBtinp; Teachers 

The teachers participating in the project represent all 
faculty members in the two selected schools who were teaching 
"academic" subjects in grade levels 9-13 during the 1965-66 
school year,., ("Academic" subjects are defined as classes in 

foreign languages, language arts, mathematlcsi science, or -social 

studies for purposes of this investigation.) a total of 39 (21 

at School A and 18 at School B) particlpatdd In the study. 

Selected biographical data for the participants is presented in 
Table 2, 

The reason for restricting participation to teachers in only 
the academic areas is simply that the process of marking itself 
is undoubtedly quit* different in academic, vocational, and 
service courses. Since the objectives of instruction and the 
methods of evaluation tend to differ for academic as opposed to 
non-academic subjects, the present investigation was limited to 
a consideration of only the former. The in-service program de- 
scribed below could therefore be developed with primary focus 
upon those problems .and Issues in the assignment of marks which 
are of most concern in academic subject areas. 
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Table 2 

Biographical Data for the 
Participating Teachers 







School A 


School B 


Total 


M 


Sex 








M 


Female 


lA 


IP 


28 




Male 


5 


6 


11 


1 


Total Years 




1 




A* 

?* 


Experience 










Less than 5 


5 


1 


6 


/ 


6-10 


8 


5 


13 


% 


11-20 


5 


3 


8 


% 


More than 20 


3 


9 


. 12 




Highest Degree 










B*A^ or B.S* 


8 


6 


14 




M*A. 


12 


12 


24 


1 


Ed «S • 


1 


0 


1 


'1- 


Subject Area 


# 






■t'j- 


. ^ , Foreign Lang* 


5 


2 


7 


*1^ * 


Lang* Arts 


5 


4 


9 


> 


Mathematics 


k 


3 


7 


% 


Science 


3 


3 


6 




Social Studies 


k 


6 


10 



In-Service Prograin 

A special in-service training program on marking practices 
was developed as part of the over-all study* The primary objective 
of this program was to discuss with the participating teachers 
certain philosophical and practical issues involved in the assign- 
ment of marks to students* 

Each teacher was assigned an identification number at the 
first training session and was assured that all data collected 
during the course of the project would be identified by number 
only* Teachers at School A were assigned the numbers 01-21 and 
jteachers at School B were assigned the numbers 30-lf.3 and 
(Teacher 1|4 chose not to participate after the first session)* 

These numbers will be used In the. presentation and discussion of 
all data for individual teachers* 
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The early part of the In-serTice program waa devoted to \ 

basic notions In classroom testing and the statistical treatment i 
of test results. The latter portion o.’ the program was concerned 1 
with ways In vdilch test and other types of classroom performance 
data can most appropriately ’je translated into school marks. j- 

An outline of the topics covered in the program and a fuller dis- 
cussion of the materials used can be found in Appendix A. 

The in-service program began during the third week of the 
second semester of the 1965-66 school year. The program consisted 
of weekly one-hour sessions after school over an eight week period i 
during the early and middle part of the second semester. These 
sessions were held on Monday at School A and on Tuesday at School B. 
Since participation in the project was voluntary, there was no 
requirement that teachers attend all the in-service sessions. 
Therefore, no attendance records were kept on individual teachers. 
However, the sessions were generally well attended and it was 
rare for more then 3 or l|. teachers to miss a session. 

The in-service training differed in one major respect from 
the initially planned program. It was originally proposed that 
the in-service program extend over an eight-week period with 
two hours per week for a total of 16 hours. It became apparent 
that this was not going to be possible during the Initial dls- ! 

cussion of the project with the school principals. Bach hour of ! 

> 

participation in the program meant an additional hour spent at i 

the school for all the participating teachers. Since the remaining I 
teachers (non-academic subjects) in the two schecls were j 

no comparable investment of time and energy, the problem of "morale" 
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and cooperation among the participants would have been serloua 
for a 16 hour program* Therefore » the 8 hour program was* 'adopted 
as a compromise between what would be opti»^l in terns of coverage 

.i ... 

of topics and wtat would be optimal ixi terms of the motivation and 

J* . ‘ ^ . t ^ " 

cooperation of the participants. 

Types of Data Collected 

Several diff^^rent types of data were collected during the 
course of the project in order to obtain a comprehensive picture 
of the marking practices of the participating teachers* Each 
type of data gives unique information about marking and provides 
answers to questions concerning different facets of the process 
of assigning marks. The various types of data collected and 
analyzed in the present project are described briefly in the 
following sections* 

1. Marking Questionnaire Data 

A self-report instrument entitled simply "Marking Questionnaire 
was constructed and administered to all participants during the 
first in-service training session. This questionnaire is based 
upon a previous instrument used in a national survey of the 
marking practices of approximately 1|.000 secondary teachers 
(Terwilljger, 1966). The quest ionnaf.re consists of three sections 
(Part I- Identifying Information, Part II-Marking Practices, and 
Part III- Attitudes Concerning Marking) and is largely multiple- 

choice in format. Data from Parts I and II only will he discussed 

0 * 

in this report. 

«' • * * 

In Part I, each teacher was asked to specify the first class 

\ s ’*•*•*{ ♦ 

he (or she) taught on Monday* Data for " this class only were 
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collected ^ analyzed to this etudy . Thepefore. the findinge 
to be repopted to followtog aectione ape reatrlcted to only one 
specific class taught by each of the paptlcipattog teachepa. 

The extent to which the pssults aiay have bean diffepent if all 

% 

Classes taught by the participating teachers had been included 
is not farnowne - 

The p/artlcipants were asked to cong>lete the Marking Qnee- 
tionnaire a second time late in the second semester of the 1965*66 

school year. A ccnqplete copy of the questionnaire is presented 

in Appendix B. 

*• • . 

2. Marking &ercise (Simulation) Data 

Tv/o fbms (a and B) of a specially dosigned Marking Exercise 
were used in the study. The purpose of the exercises was to 
study the marking behavior of the participating teachers under 
more controlled conditions than exist in the natural school setting. 

Each form consists of a description of 20 hypothetical students 

^ « 

simulating a class viiich the participant is o assume he has just 
taught for a six-weeks period. Brief biographical sketches are 
provided for each student along with data representing qulzg 
examinatlony ST:-! dally hexoework scores. Hkich participating 
teacher was asked to assign marks . to each, of the hypothetical 
students using the same procedures as with h)ta own students 
Insofar as possible. Form A was administered as a "take home" 
problem at the beginning of the in-service program, and Form B 
was administered late in the second semester., A ef * 

Ficrm A and a fuller description of JBttlfiiare given in Appendix C. 
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IX 

3* Standardlead Test Data 

Hlatorleally> standardised aptitude testa came into existence 
^s a means of predicting achievement in the classroom as re- 
flected marks a student made. Standardised achievement tests 
came into existence because the marks of different teachers do 
not necessarily represent the same type and amount of achievement. 
A vast body of research on the relationship between scores on 
standardized measures (aptitude and achievement) and average 
school marks suggests a moderately strong positive relationship. 
However* little is known concerning the relationship of standard- 
ized test scores and the marks assigned by individual teachers. 

A major question of this stud^ is concerned with the general 
nature of this relationship and the degree to idiich it varies 
from teacher to teacher. Therefore* standardized test data 
available in the central office at each of the participating 
schools were collected. 

The general procedure was to obtain a conq>lete class ^ster 
for the first class taught each Monday by each participating 
teacher (the only class used for each teacher in this study) and 
to record from the school files all available standardized test 
data for each student on each roster. Due to the nature of the 
testing programs at the two schools* different data are available 
for students in different grade levels. Table 3 summarizes the 
types of scores obtained from the records at each sohool. The 
only standardized test score available for students at all grade 
levels in both schools is the Otis Quick Scoring Test of General 
Ability (IQ). 
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Table 3 



Orade 9 



^ i 

Grade ~10 



Grade 11 



Grade 12 



StMdwdlzed Test Scores^ Obtained from 
Student Piles at the Participating Schools 



School A 

HAT 

Word Knowledge 
Reading 
Spelling 
Language 

Language Std. Skills, 
Arlth. Conqputatlon 
Arlth^. Prob. Solving 
Soc. Stds. Info. 

Soc. Stds, Skills 
Science 

Otis 

MAT 

Reading 

Spelling 

.]^guage 

Soc. Stds. Info* 

Arlth. Cooqputatlon 

Arlth. Prob. Solving 

Science 

Otis . 

Otis 

ACT. 

Shgllsh 
Mathematics 
Social Studies 
. Natural Science 
Composite 

Otis 



School B 



MAT 

Reading 

Spelling 

Language 

Soc. Stds. Info. 
Arlth. Conqputatlon 
Arlth. Prob. Solving 
Science 



Otis 



Same as 9th grade 



Same as 9th grade 
ACT 

English 
Mathematics 
■Social Studies 
Natural Science 
Composite 

Otis ‘ 



Metropolitan Achievement 

CollSg* Uct). recorded for all American 

Teat foti^''' * scorea for the Otis Qulck-Scorlng 



It. Teacher Mtirkin^ {(grading) Data 

5Phe final t^# of data collected is that idjdch la most central 
to the project, l^e actual marks or ^ades assigned bj 
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teacher to the students enrolled in his (or her) first class 
each Monday were reproduced from the teacher’s grade record 
book* To assure that all data (Including quiszes, homework* 
tests* etc*) were obtained* actual photographic copies of each 
teacher’s record book were made on copying machines available 
in the central office at each school* All data available in each 
teacher’s record book for both the first and second semesters of 
196$*66 were duplicated c The only exceptions were a few instances 
in which record books could not be located* These are noted in 
the discussion of the results* 

The amount and relative conq>leteness of the data available 
• ' in the teacher record books naturally varies greatly from teacher 
to teacher* In order to analyse systematically the data foe 
all teachers according to a general procedure* it was necessary 
to limit the amount and type of data included* Inspection of the 
grade record books revealed that many teachers had recorded a 

' I / * > * ' * * 

complete set of marks or scores for no more than three assignments 
or quizzes' durinfs a given six-weeks period* Therefore* a decision 
was made to limit the number of recorded marks or scores to three 
for assignments and quizzes during any slx-waeks period* In 
addition* a nix-weeks daily average* a six-weeks exam* and a 
final six-weeks mark were recorded for each of the three marking 
periods in a given semester* Semester exam marks and final semes- 
ter marks werci also recorded* This results in a total of 20 
possible nuirks or scores for each semester* Of course* many 
teachers had not assigned this many marks* 
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A brief comment shouia be made concerning the nature of the 
data available in the teacher grade record books. With few ' 
exceptions, all test, quiz, and other data were recorded by 
teachers ip the form of letter grades (A, B, etc..)^ This meaSs 
that no direct numeric scores were available for moat teachers.’ 
The teachers explained the exclusive use of letter marks resulted 
from a system-wide policy prohibiting the use of numeric data 



in any form. Although maj^ teachers (as well as the investigator*- 
expressed disagreement with this policy, few were willing to vio- 
late it. Some teachers v/ent to the extent of keeping, two separate 
record books, one for their own use with numeric data and a second 



for the "official" records with letter grades only. These teachers 



would allow only the "official" records to be used la -jhls study. 
This has two linportant consequences for this study. ' ' 

First, the exclusive use of letter marks obscures many of ' 
the issues rfjich this stu^ set out to clarify. When only letter 
narta are recorded in a teacher's record book it is not possible 



to distinguish the measurement process from the evaluation process. 

That is, concepts such as "difficulty level" and "dlscrimiaablllty" 

refer to characteristics of classroom tests whereas concepts such 

as "marking standards" refer to practiqes employed by the teacher ' 

In making value Judgments concerning performance on tests and 

other assignments. Since, numeric .data are not available in this 

stu^, no conclusions can be drawn concerning the measurement 

devices employed by these teachers. Consequently, it is impossible i 

to determine what role classroom measurement plays in the assign- | 
meat of marks. ^ 
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Second, much of the material specifically developed for and 
used in the in-service program was ir*relevant for those teachers* 
For e3can?)le, all of the material on the organization and statis- 
tical treatment of test and quiz scores is meaningless in a 

m 

situation where the use of scores is actively disconraged* 
Similarly, much of the material on test construction and item 
ar4&lysis loses its meaning without the notion of quantifiable 
test results. Under these circumstances, the potential Impact 
of the in-service program is considerably diminished. 

A final (but less in^ortant) consequence cf the use of 
letter marks is that all teacher records had to be translated 
into some arbitrary numeric scale for purposes of data analysis. 
The scale adopted in this study is described in the next section. 



\ . 
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RESULTS 





. The presentation of the results id. 11 be structured according 
to the various types of data previously mentioned* The data for 
iridividual teachers are presented in appendices when they are 
too, complex to be summarized easily in tabular form* Wheneverr'*"- 
individual data are presented, teachers will be identified .by 
number cnly. For most types of data, separate summaries for each 
school and for both schools combined will appear in the text of 
the report and the more detailed results on which these summaries 
are based can be found In the appendices* Formal statistical 

tests have not been used since the primary objective of the study 

*• 

is to explore the nature and magnitude of Individua;^ differences 
among the teachers. The reader who is interested in formal 
comparisons among various groups of teachers (e*g* School A vs. 
School B, Language Arts vs* Mathematics, etc*) will usually find 
. the. necesssiry raw data in an appendix* 



Standardized Test Data 

Perhaps the most meaningful way to contrast the two schools 
is to examine the standardized test data obtained from the student 
files* Before doing so, two comments are in order. First, data 
for only thosp students in one partlculcu* class, taught by each 
participating teacher were obtained from the school files. Second, 
con^lete test data were not available for all. the students in 
each class used in the study. For these reasons the data pre-. 

sented hero may not representative of the total student, bodies 
at the two schools. 
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It was previously noted that di£*forent types of standard- 

s 

Ized test scores were available for the different schools and 
grade levels within a school (sde Table 3). Therefore, the 
standardized tost data are presented separately for each grade 
level uid each school. Tables 1|.*10 present the san^le sizes, 

Cleans, standard deviations and intercorrelations of standardized 
tost scores for each grade level from 9 through 12 at the two 
participating schools. The only exception is grade 11 at School A 
idiere the only test data available is the Otis. The mean IQ 

for the 57 students in that group is 118 and the standard deviation 
is 10.5. 

The average Otis IQ is well above that for an unselected 
san?>le from the general population in all grades at both schools. 

As might be expected, there tends to bo less variability than in 
the general population. It appears from inspection of these data 
that the IQ scores in School A tend to bo reliably higher than in 
School B (especially in grades 10 and 11) despite the fact that 
both school averages are above the value for the general population. 
No formal test of the mecm difference in IQ was made since these 
are not random samples from the two schools and because the explor- 

t 

at Ion of such differences was not considered relevant to the 
present study. 

The Intercorrelations among the various test scores within 
each grade tend to be reasonably high although there are percep- 

table differences between the schools. The median correlation of 

* # • • 

IQ with all types of achievement scores in School A is .62 and in 
School B it is .56. The reason for this difference is not known 
althou^ it may reflect a generally higher (and more uniform) 
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IfouM, Standard Daviatlora md Correlations Among Test Scorea^'^ 

Ninth Orade— School A (»=89) 



Metropolitan Achievement Test 



NK 

R 

ap 

L 

LSS 

AC 

AP 

SSI 

SSS 

Sel 

Otis 



WR 



7W 

ti68 

501^ 

429 

355 

344 

556 

520 

509 

550 



Mean 7,1 
SO 1.3 



458 

521 

422 

482 

489 

694 

553 

560 

557 

6.9 

1.7 



Sp 



576 

462 

522 

514 

its 

530 

553 

7.0 

1.7 



741 

600 

627 

494 

557 

349 

612 

6.4 

1.5 



£S3 AC 



533 

584 

470 

423 

413 

531 

6.3 

1.4 



726 

60^ 

491 

559 

6.8 

1.7 



AP 



SSI SSS Scl Otis 



516 








554 


682 


««« 




459 


665 


598 




619 


560 


564 


SlS 


6.9 


7.0 


6.8 


6.6 


1.6 


1.5 


1.5 


1.7 



116 

8.3 



^olltSi^?cMfve*S?nrTest^^^ subtests of the Metro- 



MK»Word Knowledge 
R»Readix^ 

Sp-Spelling 

IfLanguage 

LSS»Language Studiy Skills 



AC-Arlthinetic Confutation 
AP«*Apitbnietlc Ppoblen Solving 
SSI«3oclal Studies Information 
SSS-Soclal Studies Study Skills 
Scl«Sclenee 



hf™ S®** on all Metr<^olltan Achievement Tests. 
Decimal points have been omitted In all correlation matrices. 



-S 

V I ja I I I ■ ii 1 a .. 

UD I J WM ' f 















! 1 



1 , 



19 



Table 5 









neiii-^oxiTian Achidvement Teat 



R 

Sp 

L 

SSI 

AC 

AP 

Sel 

Otis 



SD 



R 


Sp 
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SSI 


AC 


AP 


585 

736 

521 

601 


636 

395 

5i|.o 


56o 

703 


ii83 






623 


410 


606 


550 


714 


••• 


539 


403 


527 


606 


573 


554 


699 


629 


771 


655 


693 


642 


6.3 


6.2 


6.0 


6.0 


5.9 


6«0 


1.6 


1.8 


1.9 


1.6 


2.1 


2.0 
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1.7 11.1 
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Table 6 
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H 


S3 


NS 
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1 

Otlg * 


E 

M 

SS 

ES 

C 

Otis 


460 

527 

499 

735 

613 


596 

635 

822 

727 


764 

871 

697 


«»«•«» 

877 

707 


828 


* 


Mean 

SD 


20.9 

4.8 


22.4 

5.7 


23.6 

5.6 : 


23.2 

5.4 


22.5 

4.5 


117 

9.3 * 



« u.,a to to toM.„ ciito 



E-Engllsh 
M*Mathemat ies 
SS*Soelal Studies 



ES«Natural Science 
C*Conpoaite 



ACT standard scores are employed# 
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Table 7 



Means* Standard Deviations and Correlations Among Test Scores 

Ninth Grade«»Sch6ol B (N=38) 



Metropollteoi Achievement Test 
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Sp 
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SSI 


AC . 


. AP 


Vli 


R 














,'5' 


Sp 


3l^l 


••• 










i'i'j 


L 


419 


847 












SSI 


So5 


522 


446 


•••• 








AC 


256 


338 


250 


481. 






0 

•yi 

s 


AP 

Sci 

Otis 


438 

469 

430 


539 

im 


440 

318 

522 


477. 

517 

682 


: 662 
- 376 

555 


mmmm 

411 

573 




Mean 


7.4 


7.4 ' 


7.8 


7.6 


7.2 


7.1 


t'** 


- SP 


. li^ 


2.0 


1.8 


1.4 


1.9 


2ol 



AP Sei Otis 



597 



6.4 

1.7 



115 

9.5 



Table 8 



Means » Standard Deviations and Cor relations Among Test Scores 

Tenth Grade— School B (M»116) 



Metropolitan Achievement Test 
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if. 


R 


^mm 


• 












>2i~ 


Sp 


323 
















L 


592 


571 


eeeeee 










I 


SSI 


572 


225 


405 










i-H 


AO 


516 


364 


596 


351 


mmm 






h 


AP 




235 


369 


255 


657 






K 


Sei 


425 




•358 


425 


460 


489 


mm^ 


'S 


Otis 


49l|. 


478 


627 


327 


568 


586 


534 


k 


Mean 


^ • t*. 

5.7 


5.1 


5.1 


5.4 


4.9 


5.1 


5.5 


% 


SD 


1.4 


1.8 


1.5 


1*4 
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1.5 
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Table 9 



Means, Standara Deviations and Comlatlom Anotig Test Scores 

Bleventb Orade— Sohobl B^ ' (N=67) 



Metropolitan AehlevesieBt Test 



Sp 



R 

Sp 

L 

SSI 

AC 

AP 

Sol 



5i6 

609 

6Wi 

U61t 

639 

6R2 



Otis 655 



615 

374 

384 

450 

387 

586 



Mean 5>6 
SD 1.6 



5.9 

1.7 



Xt 


SSI 


AC 


AP 


Sei 


Otis 


392 






- 






556 


507 


*•» 








675 


575 


738 
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h66 


725 


Wo 


598 


«»««• 




687 


522 


W3 


595 


552 
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5.9 


6.1 


6.2 


5.6 


107 


1*5 


1.8 


1-5 


: 1.4 


1.7 


10.5 



Table 10 



Means, Standard Deviations and Correlation^ Among Test Scores 

Twelfth 6rade«*School B ‘ (N«38) 



/nerlean Oollege Teat 
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Otis 
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6kS 
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Mean 
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19.7 
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ftchtevement motivation in School A which would tend to nate 

eeneral ability a better predictor of achievement. This 

explanation is also consistent with other known characters tics 

of the two schools, e.g. the percent of the 1966 graduates who 
are college bound. * 

The correlations among the various measures of achievement 

within each group tend to cluster in the ,k0~.60 range with 

occasional higher or lower values. The lowest single correlation 

among the achievement measures is .23 and the highest (excluding 

part-whole correlations) is .66. These data certainly suggest 

that the concept of "general achievement" is a valid one where 

achievement is defined hy performance on measures of this 
type. 

First Semester Grade Data 

The data reproduced from the first semester grade record 
books of the participating teachers were analysed in several 
different ways. The first step was to convert all letter' marks 
into numeric values. A 13-polnt numeric scale was adopted for 
this purpose since it was deemed desirable to keep distinct all 
possible letter marks from A^- through P. The following conversion 
wee made for all letter grades: A*=13. A*12. a.=11, — , d=3. 

D-=2, and P=l. All analyses of the teacher grading data were made 
using this 13-polnt scale. 

31x^We^*]^ktag**Perlods* During 

We will begin our consideration of the marking data by re- 
stricting attention only to those marks based upon work done 
Within individual six-week marking periods. As previously noted. 
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up to three different, quiz > test» pr hcH^work marks were re« 
corded for each teacher for each nuu^klng period* A dally 
average and a elx-week ..t^t mark were also recorded when available 
— w„«„ J,U*B yiexoa s xocai or 15 auch marks for the 

three six-week periods In the first semester. The means and 
standard deviations for all rnuks recorded by a teacher were 
coB5.uted in all eases .idiere relatively eon^lete data were available. 
, Data from four teachers in School A could not be in this 

analysis due to the ineonpleteiMas of their records. 

Table 11 shows the distribution of these means (using the 
13-potot scale) by school aqd type of data> i.e. six-week tests 
vs. quizzes and daily work. The distributions in Table 11 
gr^hically Illustrate the individual differences between teachers 
(and within a teacher on different occasions) with respect to 
"standards" of performance. The data in Table 11 constitute 
Oarking "norms" based upon a total of 3l^l^ quizzes snd daily assign- 
ments (188 in School A and 156 in School B) and 85 six-week tests 
(U6 in School A and 39 in School B) . it is quite clear that 
teachers in both schools emplt^^^ higher standards on six-week tests 
than on dally work and qulzzemi«H«n over-all mean of 6.9 (C+) as 
eoaqcared to 8.0 (B-). There is also evidence that teachers in 
School A assign higher marks than do those in School B. Perhaps 
this xmflects a conscious atteng>t to adjust standards of perform- 
ance to cog^ensate for a higher general ability level at School A. 
Despite these average differences, there tends to be greater var- 
iability within School B than In School A. For exaiiq>le. Teacher 33 
(Remedial English) gave 11 quizzes and dally assignments with an 



\ 



o 

ERIC 






T\.-f -f" 















Table 11 

Distribution of Mean Class Marks For 
Quizses* Daily Work and. Six-Week Tests 






School A 
Frequencies 

Mean Daily Work Six»Week 
Mark & Qnizzes Tests 



First Semester 

School B • Total 

Frequencies 

Daily Work Six-Week Daily Work Six-Week 
& Quizzes Tests & Quizzes Tests 



i 13.0 

1 12.5 

« la.o 

i 11.5 


2 

7 




1 

0 

6 


i 


1 

2 

13 




11.0 


10 


1 


5 




15 


1 


1 10.5 


14 


1 


5. 




19 


1 


i 10.0 


20 


3 


6 


1 


26 


4 


1 9.5 


9 


0 


7 


1 


16 


1 


5 9.0 


16 


5 


14 


3 


30 


8 


1 8.5 


23 


2 


17 


8 


40 


10 


j 8.0 


19 


2 


2 b 


2 


39 


4 


1 7.5 


17 


1 


11 


4 


28 


5 


1 7*9 


12 


8 


14 


2 


26 


10 


6.5 


15 


6 


11 


3 


26 


9 


1 6.0 


10 


4 


6 


3 


16 


7 


i 5*5 


6 


6 


7 


4 


13 


10 


1 5.0 


5 


4 


6 


1 


11 


5 


1 t .5 


, 1 


2 


6 


1 


7 


3 


i h.o 


0 


1 


9 


1 


9 


2 


1 3.5. 


0 


« 


0 


2 


0 


2 


; 3.0 


1 




3 


1 


4 


1 


1 2.5 


0 




1 


1 


1 


1 


i 2.0 


1 




1 


0 


2 


0 


1 1*5 

j 1.0 

1 


168 


1(6 


156 


1 

39 


344 

8.0 


1 

85 


1 . Maan 


6.1 


i 7.0 


7.6 


6.7 


6< 


1 3D 


l .( 

1 


J 1.7 

• • • 


2.1 


2.1 


2.0 


1, 


1 over- 


•all mean 


grade of 4*2 


(D***) while Teacher 4^ (Latin 1) 


gave 



12 quizzes and daily assignments with a composite mean grade of 
10.6 (A-) • Similar differences obtain for six-week tests ^en 

• j • ^ * 

specific extreme teachers are selected. 
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A second type of analysis was performed for a subsao^le 
of five teachers from each school* Multiple regression equations 
predicting cix-ueek marks from all data recorded in each marking 



w* *A»WW w ^ WffW VWvSW 1/JbW^O W* 






information; (a) the degree of predictability of assigned slx* 
week marks, and (b) the relative weight each piece of data carries 
in the prediction of the assigned mark* Since this analysis was 
exploratory and involved only ten teachers, the results and dis-* 
cuss ion are presented in Appendix D* 

2* Marks Reported to Parents 

The most important marks to the student are those which 
appear on his report card* The marks reported each semester to 
students and their parents in the secondary schools of Nashville 
are the three six week marks, the semester examinatidn marl^ and 
the final semester mark. The means and standard deviations for 
each of these marks are given for each teacher in Table 12. The 
only exceptions are Teachers 3, 21, 43i* end 1|.2* In each of these 
cases the appropriate data were not available when the record 
books were duplicated* These data reveal in great detail the 
nature and extent of differences among individual teachers with 
respect to their practices in assigning marks* For exanq>le, con- 
tr'^st the. mean marks assigned by Teacher 1? with those assigned 
by Teacher 1[|.. The mean for the first teacher is about 9«0 (B) 
and for the latter it is 5*5 (between C- and C). This is a 
substantial difference and is not entirely explained by differences 
in the ability levels of theCe classes* (The mean Xq in the first 
class is 121 and in the second it is 113 ») 
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I.D. 

Ho. H 

01 27 
02 30 
0l^ 27 

05 16 

06 17 

07 23 

08 27 

09 25 

10 28 
11 21 
12 27 
13 26 
It 2t 

15 2t 

16 31 

17 30 

18 18 

19 28 

20 23 
30 20 

31 32 

32 27 

33 23 



ls6 
6 Wks 



3 



25 

27 



36 32 

37 23 



38 27 

39 v32 
to 26 
t3 :lt 
tS 24 

46 29 

47 26 

48 26 



5.3 2.7 

8.3 2.7 

7.8 3.0 

7.6 2.2 

8.7 1.4 

lao .9 

8.2 2.1 

6.8 3.6 

7.3 3.1 

7.2 2.5 

6.8 2.7 

8.2 2.1 

6.2 2.4 

10.7 2.2 

7.2 2.9 
1Q3 1.4 

9.0 3.4 

8.2 1.9 

9.2 2.2 

7.8 3.0 

6.5 3.2 

5.0 3.0 

2.9 1.7 

6.8 3.5 

8.2 3.0 

6.1 2.4 

6.6 3.0 

7.0 3.7 

7.2 2.8 

8.5 2.6 

7.5 2.4 

8.2 3.4 

6.1 3.1 

8.3 3.0 

9.5 2.9 



7abl« 12 

Means and Standard Deviations 
of Reported 
First Semester Harks 



2nd 
6 Wks 



6 Wks 



M SD “R SO 



1: 

I 



5.9 2.6 
^.8 2.4 

1.6 2.3 
.4 2.0 
>.2 1.8 
W.3 .9 

8.0 2.4 
6.6 3.5 

7.3 2.9 

7.5 3.0 

7.6 2.6 

7.7 3.3 

5.3 2.4 

10.4 2.1 

7.4 2.5 
10.3 1.9 

6.6 4.0 

7.1 2.4 

7.7 2.4 

7.7 3.0 

5.2 3.2 

5.5 2.7 

4.8 1.5 

7.6 3.6 

6.7 2.9 

5.7 2.8 

8.9 2.2 

6.6 3.4 

6.9 2.9 

7.4 3.4 

8.6 li7 

8.9 2.5 

4.7 2.9 

8.9 3.7 

8.8 2.6 



6.2 2.9 

8.6 3.3 

8.1 3.0 

8.0 3.3 

7.8 1.6 

9.0 1,8 
7.5 1.5 

5.9 3.4 

7.4 3.1 

7.7 2.4 

8.2 2.7 

5.3 3.2 

6.2 2.3 

10.0 2.7 

7.8 2.4 

30.3 1.5 

7.5 2.9 

8.8 2.2 

9.2 2.5 

8.0 2.9 

4.9 3.4 

5.7 2.8 

3.7 1.9 

7.5 3.7 

6.0 2.3 

5.2 2.7 

8.2 2;7 

7.7 2.7 

7.1 2.7 

6.6 3.2 
8.4 1.6 

8.3 2.5 

10.3 1.4 
7.4 3.8 

8.8 2.7 ■ 



*tiOw ability group 
2 

I»ow ability renodlal sootlon 



A Am 

Exam 



Hark 



M SD M SD N SD Subject 



5.6 3.9 

5.8 3.2 

7.7 3.6 

7.6 2.6 

7.6 2.5 

8.6 1.8 

9.0 2.8 

5.0 4.4 

6.0 3.4 

5.0 3.1 

8.4 2.8 

7.4 3.5 

5.0 2.6 

8.1 2.7 

7.1 3.3 

7.1 2.8 

5.8 2.9 

5.1 3.6 

7.2 3.1 

6.2 4*7 

5.2 2.7 

5.2 3.4 

4.4 2.0 

5.8 4.3 

5.0 4.0 

5.9 3.1 

8.4 3.0 

6.3 3.7 

8.0 4.1 

7.6 3.8 

7.6 2.6 

6.5 3.7 

3.3 2.6 

6.6 3.2 

4.9 4.3 



5.8 3.0 

8.0 2.7 

7.9 2.9 

7.7 2.2 

8.2 1.7 

9.6 1.2 

8.3 2.0 

5.9 3.5 

7.2 3.1 

6.8 2.7 
8.1 2.7 

7.2 2.8 

5.7 2.2 

9.8 2.5 

7.5 2.4 

8.8 2.0 

7.3 3.0 

7.4 2.2 

7.9 2.4 

7.2 3.2 

5.3 2.9 

5.4 2.7 

4.4 1.7 

7.2 3.6 

6.2 2.5 

5.8 2.4 

8.5 2.6 

6.7 3.0. 

7.1 2.8 

7.4 3.2 

7.9 1.9 

7.7 3.1 

5.7 3.1 

8.0 3.2 

8.0 2.8 



Biology 
Am. Govt. 
Spanish 
French 
French 
Bhglish 
English 
History 
Spanish 
Biology 
Latin 
Algebra 
English 
Algebra 
Sociology 
History 
Bus. Arlth. 
.Algebra 
^BloL( Special) 
Adv. Hath. 
Oeometry 
.Biology 
‘^Eng. (Special) 
English 
Biology 
Geography 
Am. Govt. 
History 
History 
Algebra 
Geography 
Spanish 
English 
History 
Latin 
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A more compact summary of the data in Table 12 Is provided 
in Table 13 idiere the grand mean grade and the variability among 
the mean grades is given for each six-^e^k period^ the semester 

exanii and the final semester mark* Table 13 again reveals that 

■* 

teachers in School A tend to mark higher tl^ do teachers in 

School B* The average in School B shows a remarkable, consistency 

across the three gradlzig periods but» as with the quia' and daily 

marks, there tends to be slightly greater variation from tes 4 ^.her 

• • • . 

• * * . • • • 

to teacher than In School A. In both ‘ school^ there is a notice* 

able drop in semester exam marks ds cdnpared with other reported 

0 f 

* • • * 

marks. 

Despite the overall high ability level, there remained con* 
siderahle variation in mean TQ from class to class. 

A check was made to see* if tiie variability in the average 
final mark might be explained by differences in the average 

general ability of the classes. The correlation between average 

« » • 

class IQ and average final mark was computed for both schools 

i 

combined (N=35) and found to be .57. Therefore, slightly over 

• ^ 

one*fourth of the variability' in average assigned marks can be 
accounted for by differences in the average ability as measured 

• V ^ 

by the ptis. A. substantial portion of the variability, in average 
marks is evidently due to other factors. 

The inter correlations of IQ and marks for each six weeks, 
final exam and total semester were also obtained within each class 
with at least 15 students with complete data. Sixteen teachers in 
School A and 12 in School B met this criterion. The resuSlting 
matrices are shown in Appendix E. The correlations between IQ 
and final semester marks are summarized in Table li|.« 
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Table 13 



Means and Standard Deviations of 
Average Heported Marks 
First Se^ster 



• 




1st 

6 Wc 

• 


2nd 
6 Wks 

• « . a 


3rd 
6 WIcs 


Sem. 

Exam 


Qmwm 

Mark 


School A 


M 


6.1 


7.6 


7.9 


6.6 


7.6 


(N=19) 


SD 


1.4 


1.3 


1.3 


1.3 


1.1 


School B 


M 


7.1 


7il 


7.1 


6.1 


6.6 


(N=16) 


SD 


1.6 


1.5 


1.6 


1.3 


1.1 


Total 


M 


7.6 




7.5 


6.5 


7.2 




SD 


1.5 


1.5 


1.5 


1.4 


1.2 



Table Ilf. 



Distribution of Correlations *of Otis IQ 
with First Semester Marks 



School A 



School B 



Total 



.75 

.70 

.65 

•60 

.55 

.50 

.45 

•40 

.35 

•30 

.25 

.20 

.05 

.00 

-.05 

-.10 



3 

1 

1 

1 

2 

1 



2 

3 



4 

1 



2 

2 

2 



2 

6 

1 

1 

2 

2 

1 

2 

2 

6 



1 

1 



1 

1 



N 

M 

SD 



16 

.36 

.24 



12 

.n 



26 

.41 

•22 
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It is difficult to generalize from samples as small as 
those given in Table ll|.. However, two features of the data 
deserve comment. The average correlation of IQ and final marks 
is substantially higher and the variability in this relationship 
is less from teaoher to teacher in School 5. The distributions 

tend to be bimodal in both schools with one group of teachers 

* ' • - • »' * 

clustered in the '.60-»70 range and a second group clustered around 

.25-.3S; 

Since the general ability level is higher in School A, it 
seems reasonable to assume that the lower average correlation of 
IQ and marks might be a result of atte it nation due to restriction 
of range in ability. Specifically, these cases in idiich the 
correlation is very low may simply be the most able (and least 
variable) classes with respect to the Otis. This is borne out 
in the two cases vAiere small negative correlations were obtained. 
In each instance, the mean IQ is greater than 120 and the standard 
deviation is about 6.0. Yet, some caution is needed in offering 

9 

this explanation for all low correlations because counter-examples 
are also available, e.g. the correlation between IQ .and marks is 
.i|.0 for one class with a mean IQ of 12i|. and a standard deviation 
of 5.0 and is .60 for a second class with a mean of 121 and a 
standard deviation of 9.0. 

It is also instructive to contrast the magnitude of the 



Otls-mark correlations with the intercorrelations among the marks 

» • *10 

for individual teachers (see Appendix E) . ' Although no attempt has 
been made to formally summarize these, it is obvious that the Otis 
is not accounting for a large part of the general variance in 
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marks since the intercorrelations among marks are typically in 
the .80-. 90 range ^’e the correlations with the Otis are much 
lower. This tends to be true regardless of mean IQ level in a 
class. I 

A final analysis of the marking data consists of deriving 

f 

a multiple regression equation for each teacher predicting semester 
marks from marks for the three six- week periods and the semester 
exam. The zero-order correlations among these variables are given 
for each teacher in Appendix E. The purpose of this analysis is 
to determine the over-all predictability of semester marks from 
other previously recorded data and to ascertain the relative 
weight given to each type of data in the determination of semester 
marks. Multiple regression equations were obtained for 19 teachers 
from School A and 16 teachers from School B. The remaining teachers 
did not have complete data for all the appropriate variables* 

The results of the multiple regression analyses are presented 
in Table l5« The values in the right-hand column indicate that ^ ' 

semester marks are highly predictable from previous marks. This 
is not surprising since teachers typically average previous marks 
in some fashion to obtain a final mark* Of course, if the final 
marks actually represent some linear combination of the six-week 
and final exam marks then they would be. perfectly predictable. ^ 

This is approximately the case for most teachers. In specific 
instances where a substantial proportion of the variance in final 
marks is not accounted for (e.g. Teacher 33) it may be that other 
factors such as special projects or term papers entered into the 
determination of marks. 



er|c 















Table 15 



Percent of Variance in First Semester 
Marks Accounted for by 
Period and Semester Exam Harks 



Teacher 

Number 


Six- 

'l" 


»UAolr 

vvw Wb 
2 


__3 


Q Am A M A Ml 

OwuAw o jr 

Exam 


X wax 


1 


12 


22 


33 


32 


99 


2 


21 


9 


35 


28 


93 


k 


29 


10 


28 


30 


97 


$ 


20 


.^7 


33 


29 


99 


6 


5 


4p 


15 


37 


97 


7 


IS 


14 


36 


28 


93 


8 


37 


10 


11 


38 


96 


9 


17 


% 


28 


19 


98 


10 


21 


15 


28 


28 


92 . 


11 


5 


24 


18 


46 


93 


12 

* ^ A 


1 


7 


87 


4 


99 


13 


' 6 


29 


32 


23 


90 




. .. 25 


,31 




17 . 


98 


15 


10 


24 


40' 


24 


98 


16 


0 


17 


26 


51 


94 


U 


2 


11 


25 


56 


94 


18 


14 


22 


38 


23 


97 


19 


21 


25 


23 


28 


97 


20 


. 22 


37 


20 


.21 


100 


30 


IS 


11 


23 


48 


97 


31 


12 




36 


22. 


95 


32 


26 


28 


14 


28 


% 


33 


22 


34 


-5 


31 


82 




5 


27 


50 


17 


99 


35 


11 


24 


24 


39 


98 


36 


9 


13 


33 


38 


93 


37 


2h 


11 


27 


36 


. 98 


38 


35 


21 


21 


23 


100 




0 


15 


66 


15 


96 


ho 


7 


29 


36 


27 


99 




31 


30 


-13 


50 


98 


45 


12 


20 


20 


43 


95 


V 46 


56 


13 


6 


16 


91 




23 


22 


23 


28 


96 


. 48 


19 


22 


30 


27 


98 


. Mean (A) 


15 


21 


30 


30 


96 


Mean (B) 


19 


22 


% 


31 


96 


. Mean (Total)17 


21 


.28 

• 


30 


96 
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The general ordering of the four predictors with respect to 
,v^lance accounted for** Is the same in both schools* The first 
two marking periods are relatively less In^ortant than the third 
period and the final exam* There is a slight tendency for the 
total variance to be more evenly distributed across the four 
predictors in School B. 

The data also clearly indicate that there are extreme indi- 
vidual deviations from the general trends just noted. Teacher 12, 
for example, apparently looked almost exclusively at work done 
In the third six-week period since 67 ^ of the final marks are 
accounted for by that period* The same is true to a leaser extent 
for. Teacher 39. Teachers 3^ and I 1.3 represent rare exan^les where 
one predictor (third six-week mark) actually contributes negatively 
to tlw overall prediction* This means that this predictor is 
partialling out variance in final marks which the other predictors 
have previously accounted for. The net result is that the total 
variance accounted for is reduced* 

Marking Exercise (Form A) 

All participating teachers except one completed the Marking 
Exercise (Form A) in the week between the first and second in- 
service sessions. The primary purpose in collect ing these data 
was to obtain marks assigned by each teacher under known flwd 
standardised conditions. This, of course*, is not possible in 
the natural classroom setting >diere each teacher must deal with 
a unique group of students using his own measurement and eval- 
uation procedures. The distributions of assigned marks for the 
20 hypothetical students in Form A of the Marking Exercise are 
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Bliofm in Tftbls 16* Th686 d&ta aro Tor bobh schools ootobinod 
sines the difference in results between the schools was slight* 



(PoKl* 1A 



Distribution of Assigned 
Marks for Marking Exercise (Pom A) 



Student 

Nunber 



D- D 



1 

2 

3 

6 

7 

8 
9 

10 

11 

12 

51 



1 

1 

3 



3 

1 



13 

11 

7 



3 

2 

It 



ll 






19 

20 



10 

6 



2 

6 

1 



c- c 


C+ 




B 


B+ 


A- 


A 


A-i- H 3D 


7 


6 


8 


1I^ 


1 






7.8 1,2 








2 


3 


11 


22 


U.l^ .8 


. 






8 


7 


8 


15 


S.6 1.2 


21 


7 


5 


5 








6.8 1.1 


1 


2 


5 


4 


3 




1 


8.7 1.1 


6 


k 


6 


20 


1 


1 




8.2 1.2 


19 


9 


k 


5 








6.8 1.2 


16 


6 


7 


8 








7^1 1.1|. 


5 17 


6 


3 


2 




. 




6.0 1.4 








9 


8 


9 


12 


10.6 1.2 


9 13 














4.6 1.3 


8 6 














3.6 1.6 


7 15 














4.6 1.3 


11 iii. 


2 












5.0 1.2 








6 


9 


5 


18 


10.9 1.2 


5 ax 


5 


1 


2 








5.9 1.3 


11 16 




1 










. 5.0 1.2 


7 15 














4.7 1.2 


6 16 


3 


1 


3 








5.6 1.6 






1 


6 


7 


7 


17 


10.9 1.2 



Inspection of the distributions in Table 16 shows obvious 
and consistent discriminations being made among the 20 students. 

This is also reflected in the great variation in the mean marks 
for the 20 students and the relatively low variability of the 
marks for most students* The consistency among the marks of the 
38 teachers is also demonstrated in the intraclass correlation (R) 
which is *80 for these data* (R was computed so that the average 
differences among teachers were treated as error*) Viewed in the 
context of ihat is known about rating techniques* these data would 
appear to reveal a relatively high degree of agreement among teachars. 
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However > from another point of vlew^ these data are not 
necessarily encouraging. It could be argued that an Rs»80 is 
not really so high ^en one considers the fact that all teachers 

were given the identical data on idiich to base their marks. Under 

•1 

these circumstances 9 the variability in tlt>^ marks given to certain 

•• * 

students (e.g. Students 9» 12, and 19) seems unreasonable. The 

* • » * * • 

explanation of such variability undoubtedly lies in differences 
among teachers* in the subjective values which are attached to 
different types of data available for each student. 

Multiple regression equations were computed for each teacher 
in order to determine the effective weight given to each of the 
seven scores available from the Marking Exercise. Table 17 gives 
the percent of variance in assigned marks accounted for by each 
of the scores given in the exercise. There is one inq>ortant 

t 

difference between these data and the data given in Table 15. 
Whereas each of the predictors and the criterion variable were 
generated by the individual teacher in the analysis of the first 

I 

semester marks ^ only the criterion variable is generated by the 
teacher in this analysis. The means « standard deviations » and 
correlations among the predictors are fixed and are the same for 
all teachers in the present case (see Appendix C). To a certain 
extent the range of weights which these predictors can carry is 
restricted. However^ a teacher who combines the predictors in 
specific ways can also exercise a great deal of- control over the 
weights. One basic purpose of this analysis was to determine the 
extent to which individual teachers succeeded in producing weights 
which reflect the importance they attach to various types of data. 
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Table 17 



Percent of Variance In Aeelgned 
MaPke Accounted for by the Seven 
Scores in Marking E^serciae A 



l.D. 

1 



1 


11 


2 


11 


3 

1 


19 
- 1 
7 


6 

1 


7 

1 

1 


9 


22 


10 


- 3 


11 


20 


12 


29 


13 


12 




9 


IS 


6 


16 


k 


H 


3 


18 


23 


19 


17 


20 


17 


21 


It 


30 


1 


31 


27 


32 


9 


33 


- 1 




t 


35 


30. 


36 


8 


37 


11 


38 


5 


39 


20 


LO 


12 




13 




9 


kS 


26 


w 


- 2 

5 


w 


18 


Mean 


11.2 



Quiz Number 


2 


3 


4 


12 


25 


.25 


• 5 


20 


43 


12 


0 


s 


- 6 


6 


i 


12 


16 


2 




11 


4 


5 


11 


31 


23 


1 


3 


7 


7 


20 


13 


10 


9 


• 8 


7 


25 


4 


11 


19 


11 


5 


23 


3 


-23 


33 


-11 


4 


56 


% 


3 


18 


5 


8 


24 


16 


9 


20 


13 


18 


30 


8 


0 


21 




7 


- 5 


5 


11 


31 


10 


0 


26 


7 


2 


28 


16 


- 4 


49 


9 


- 2 


23 


23 


4 


28 


6 


7 


14 


5 


26 


33 


28 


9 


30 


16 


21 


- 1 


9 


2 


26 


1 


-18 


47 


4 


21 


24 


16 


3 


2 


5 


- 4 


14 


9 


2 


9 


7 


- 8 


30 



8.7 6.0 21.8 



^ U1» 


4 i.n» 

V Vf .IW 


Test 


Test 


21 


7 


13 


10 


31 


21 


11 


57 


22 


35 


13 


41 


14 


28 


7 


24 


21 


22 


13 


29 


10 


15 


8 


2a 


3 


4 


21 


31 


0 


- 6 


15 


33 


30 . 


14 


10 


17 


6 


14 


19 


21 


46 


28 




28 




17 


14 


21 


- 6 


18 


11 


26 


5 


- 7 


33 


24 


12 


10 


4 


9 


30 


13 




25 


25 


12 


3 


26 


27 


19 


43 


34 


10 


31 


16 


19 


15.8 


20.9 
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Average 


i 


-12 


89 


- 6‘ 


86 


11 


99 


19 


94 


0 


94 


18 


99 


9 


99 


25 


82 


- 1 


98 


18 


89 


27 


96 


- 6 


89 


40 


98 


20 


94 


40 


89 


7 


94 


13 


97 


1 


96 


1 


99 


13 


99 


- 8 


.97 


9 


99' 

97 


3 


17 


98 


24 


100 


27 


98 


11 


94 


4 


96 


2 


99 


5 


90 


- 7 


92 


10 


97 


't 


95 . 
91 


- 1 


92 


8 


98 


27 


93 


13 


95 



10.5 
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The values in the right-hand colu*:ui of Table 17 indicate • 
that most teachers relied almost exclusively upon the seven 
scores for each student in assigning markci. Only a few teachers 
(I9 2 , 69 IO9 129 and 15) assigned marks based upon other factors 
in addition to these scores. This implies that the biographical 
data given for each student had little impact in the marking. 

The column means at the bottom of the table indicate that 
the scores on the last quiz and the six-week teat each accounted 
for 20 percent of the variance over all teachers. The 3-week 
test 9 the first quiz 9 and the homework average are next in order of 
importance and the second and third quiz are least important. 

These data illustrate the Importance of the variability and inter- 
correlations among scores which enter into a composite. Due to 
the way in which the exercise was constructed9 the last quiz has 
the greatest variability of all predictors and also has a high 
average correlation with the remaining predictors. Therefore 9 it 
is almost, certain to have a heavy impact on any type of average 
both directly (because of its great variability) and indirectly 
(through its correlation with the remaining predictors). This 
effect \dlll tend to manifest itself despite the fact that extra > ' 
nominal weights are typically assigned to the more major types 
of test data. Of course 9 the variances and average correlations 
of the other predictors play similar roles in determining the 
weights they havp in the multiple regression. The only thing that 
a teacher can do .to control these influences is to convert all 
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8 C 0 F 68 to a stcuidard 8cor6 8oalo (thereby equating varlancea) 

i 

and glva the converted scores the nominal weights which are. 

Judged appropriate. The data In Table 17 clearly Indicate that 

a 

teachera do not eeneralXy use such convAPAinn . . a« a 

consequence 9 the last quiz accounts for a disproportionate share 
of the variance in assigned marks, e.g. Teachers 2, 15# 33, and 4l. 
Conversely, the major six-week test often accounts for little of 
the variance because of failures on the part of teachers to use 
weighted converted scores, e.g. Teachers 1 , 13 , 15, 35, and 38. 

The obvious conclusion is that these teachers have little insight 
into the significance of differences in the variability of scores 
with which they were asked to work. 

The Marking Exercise data were also used to check the possi- 
bility that the niarklng standards employed by teachers represent 

t . • 

generalized habits which aTe consistent across’ a variety of situa- 
tions. If such Is the case^ the average marks assigned on the 

« 

Marking Exercise should correlate with the average marks assigned 
to actual students in class. The correlation between mean first 
semester mark and. mean mark assigned to the hypothetical students 
was found to be .05. Therefore, marking standards do not general- 
ize over situations such as these. 

Marking Questionnaire Data (Time 1 ) 

The frequency of responses to each item of the Marking 
Questionnaire were converted into proportions and these proportions 
are given in Appendix . These proportions are based upon hi 
respondents including the 39 participants. Teacher I4|., and a 
practice teacher at School B. Since these proportions are 
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self-explanatory no extensive comment will be made* However* 
for purposes of comparison* proportions based upon a previous 
survey of approximately 9$00 secondary teachers are also provided. 
In both the original survey and the present study great variation 
was found in the responses of teachers to specific questions* 

These data suggest the need for greater standardization of prac- 
tices in the whole marking process. As previously noted* the 
data for Part III of the questionnaire are not given because no 
norms are available for comparison. 

J • ‘V . . . 

The remaining portion of the presentation of results is 
devoted to data collected after the in-service training sessions 
had concluded. The first six-week venrha of the second semester 
were assigned by teachers during the. in-service training and the 
second six-week marks were assigned shortly after the conclusion 
of the in-service program. Therefore* if the program had any 
impact upon marking practices its influence should be obvious in 
most marks assigned during the second semester* Also* the effects 
. of the program should be manifested in the responses to Marking 
^..Exercise B and the repeat administration of the Marking Question- 
naire late in the second semester. 

However* it should be noted that differences which are found 
between first and second semester data cannot automatically be 

s ' ■ i 

attributed to the in-service program because no control group was 
used* It is possible that there are generalized differences in 
ine marking practices of teachers during the two semesters of a 
course* Only tentative statements are possible concerning the 

j 

I 

impact of the program* 
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Second Semester Grade Data 

Table 16 gives the distribution of average marks assigned oy 
teachers oh daily work, quizzes, and six-week exams during the 
second semester. iPhese data are based upon the records of 31 

■ ' ' ' ** ' "* ** . i ' 

teachers for tdiom Relatively complete data are available. The 
grand mean mark is consistently lower for both schools and both 
types of data when couqpared with the first semester data in 
Table 11. The variability in six-week test marks is greater in 
School A than School B whereas the opposite was true in the 
first semester. These differences may be due to the fact that 
the data for the two semesters are not based upon identical groups 
of teachers since the conqpleteness and availability of the record 
books varied from one. semester to the next. Under these circum- 
stances, any statements concerning the impact of the in-service 
program would be extremely hazardous . 

The special multiple regression analysis on the data within 
each six-week period was repeated for the same subsampl© of 
teachers used with the first semester data< The results and 
discussion for both semesters are in Appendix D. 

2. Marks Reported to Parents 

The means and standard deviations of the second semester 

• • . ■ .V • 

marks assigned by each teacher during each period, on the final 
exam, and for the total semester are shown in Table 19, Data for 
five teachers (2, 13, 16, 21, and 36) were not available. The 
corresponding individual data for the first semester are in Table 12. 
No attempt will be made to make comparisons between the two sets 
of data for individual teachers. 
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Table 16 

Distribution of Mean Class Marks Por 
Quizzes « Daily ifork and Six-Week Tests 

Second Semester 



Mean 

Mark 

13.0 

12.5 

12.0 

11.5 

11.0 

10.5 

10.0 

9.5 

9.0 

§•5 

6.0 

7.5 

7.0 

6.5 

6.0 

1-5 

5.0 

4.5 

4.0 

3.5 

3.0 

2.5 

2.0 

1.5 

1.0 

N 

Mean 

SD 



School A 
Frequencies 
Daily Work Six-Week 
& Quizzes Testa 



3 

3 

9 

10 

18 

17 

20 

15 

13 

12 

17 

13 

17 

9 

6 

5 

0 

2 

1 



190 

8 . 1 , 

1.8 



2 

0 

0 

' 1 

'3 

2 

•4 

1 

*3 

4 

1 

7 

3 

2 

2 

1 

2 

0 

1 



39 

6.9 

2.1 



Total 



School B 
Frequencies 

Ste-Week Daily Work Slx-Waek 
& Quizzes Tests & Quizzes Tests 



3 

2 

5 
3 

6 



143 

7.5 

2.4 



37 

6.3 

1.7 



3 

5 

8 

12 



3 




21 


3 


2 


20 


10 


2 


30 


20 


4 


35 




0 


27 


14 


2 


26 


12 • 


• 5 


29 




4 


18 


8 


2 


25 


9 


5 


18 


5 • 


3 


11 




2 


9 




5 


5 


4 


1 


6 


2 . 

4 

1 




3 

4 
1 



333 

7.8 

2.2 



2 

0 

0 

5 

i 

1 

5 

9 

5 
9 

6 
5 

3 

0 

1 



76 

6.6 

2.0 
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Table 19 

Means and Standard Bevlations 
. ot Beported 
Second Semester Harks 



I.D. 




NOe 


N 


01 


25 


03 


25 


04 


27 


05 


16 


06 


17 


07 


24 


08 


2o 


09 


25 


10 


27 


11 


20 


12 


26 




23 


15 


26 


17 


28 


16 


18 


19 


28 


20 


26 


30 


33 


31 


18 


32 


29 


33 


21 


34 


24 


35 


29 


37 


22 


38 


29 


39 


32 


40 


26 




24 


42 


30 




17 




4 


46 


26 


W 


25 


48 


25 



Ist 
6 Wks 

H SB 

5 .k 2.6 

7.8 2.2 

8.6 2.3 

6.9 2.5 
. 8.9 1.6 

10.1 1.0 

6.1 3.6 

6.1 3.1 

7.8 3.4 

9.0 2.2 

8.0 2.3 
. 5.7 2.2 

8.1 3.3 

10.5 1.8 

6.9 3.8 
8.1 2.8 
8.2 3.1 

5.9 3.7 

4.4 3.5 

7.7 2.5 

M 1-5 

5.8 4.6 

8.7 4.5 

8.4 2.5 

7.0 4.0 

5.9 3.4 

6.2 3.4 

6.9 3.5 

6.1 2.8 

6.4 2.4 
8.7 2.9 
6.6 3.0 

9.1 3.6 
7.6 2.7 



2nd 
6 Wka 

M SD 

6.3 2.6 

7.3 1.5 

7.8 2.7 

7.2 2.4 

7.1 2.0 

10.2 1.0 

8.5 2.6 

4.5 3.4 

6.8 3.0 

6.2 2.8 

7.8 2.7 

5.5 2.1 

8.6 3.0 

10.9 1.4 

6.8 3.1 

7.8 2.8 

7.4 2.5 

5.4 3.6 

4.2 3.5 

5.3 2.6 

2.8 1.9 

6.9 3.7 

7.9 2.8 

8.4 1.9 

4.6 3.4 

6.3 3.3 

6.3 3.4 

6.5 2.9 

2.6 1.7 

5.6 1.9 

8.6 2.9 

7.1 2.2 

7.6 3.7 

7.4 3.1 



3rd 
6 Wks 

K SD 

6.4 2.5 

7.7 2.4 

6.7 2.7 

7.1 2.2 

6.1 1.6 

9.6 1.6 

8.3 2.5 

4.8 3.5 

7.4 3.3 

9 2 • 0 

8.4 2.3 

7.3 2.1 

7.9 2.8 

10.1 2.6 

6.4 3.4 

9.0 1.7 

8.7 2.5 

6.0 3.5 

5.1 3.4 

7.3 2.9 

3.8 2.0 

6.9 3.6 

7.8 2.6 

7.9 2.5 

6.1 3.2 

6.4 3.2 

5.9 3.2 

8.0 2.4 

5.6 3.0 

6.2 3.0 

8.1 3.5 

6.6 2.2 

8.0 3.7 

9.2 2.4 



Sem. 

Exam 



H SD 

7.0 4.3 

7.8 4.0 

4.4 3.5 

5.0 3.1 

6.9 3.2 

9.4 1.5 

7.3 3.7 

4.1 4.2 

4.2 3.1 

7.1 3.6 

8.4 3.1 

4.8 2.7 

9.6 3.0 

9.6 2.5 

7.0 3.1 

5.0 3.9 

4.7 3.5 

5.0 3.4 

3.5 2.1 

5.5 4.2 

7.2 3.7 

9.0 2.5 

6.7 3.9 

6.0 4.4 

6.6 3.5 

4.9 3.8 

7.1 3.3 

4.9 3.1 

7.0 4.5 

4.2 3.4 

7.2 3.6 

5.0 4.3 



Sen. 

Mark 



M SD 

6.4 2:9 

7.8 2<2 

6.8 2.7 

6.8 2.3 

7.7 2.0 

9.8 1.0 

7.9 3.1 

5.0 3.5 

6.6 3.1 

8.O-2.4 

8.4 2.6 

6.0 2.2 

8.6 3.1 

9.9 1.8 

6.2 3.5 

7.9 2.2 

7.8 2.5 

5.5 3.5 

4.7 3.6 

6.2 2.5 

3.4 1.6 

6.4 3.9 

7.3 3.4 

6.6 2.2 
6.1 3.5 

6.0 3.6 

6.4 3.2 

7.1 2.7 

5.6 2.3 

5.8 2.8 

8.2 3.6 
5.8 2.8 
8.0 3.2 

7.5 3.1 
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The summary data for each school and the total sample are 
presented in Table 20. The comparable first semester summary 
is in Table 13. As in the first semester, the average marks 
assigned at School B are consistently lower than at School A* 
and deraesfter exam marks are lower th n other marks at Both schools . 
The second semester, averages at both schools are consistently 
lower than the corresponding first semester values. This reflects 
the same general finding previously noted with respect to data 
on quizzes, daily work, and six*week exams. A check was made to 
determine whether this difference could be accounted for by the 
fact that certain teachers contributed data for only one semester. 
The means for marks presented in Tables 13 and 20 were recomputed 
using data from only the 16 teachers In School A and the 15 teachers 
in School B who had data both semesters. The results are nearly 
identical with those in Tables 13 and 20. The decrease in average 
marks in the second semester represents actual changes in the 

• f 

standards of the teachers rather than differences in the samples 
used in the two s.emesters. It is not possible to state whether 

f 

this is a general phenomenon or Is a result of the in-service 
training. The change is, however, consistent with an enphasis 
in the program on the need for an adjustment of the average diffi- 
culty level of tests and assignments to the average ability in the 
group. For most teachers, this implies making such tasks more 
difficult . 

The average final marks for the second semester were correla- 
ted with average class 2Q, for all teachers where both were avail- 
able (N=32) • This correlation is .66 as compared with the .57 
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obtained for the first semester marks. This represents an in- 
crease of 11 percent in "variance accounted for The individual 
differences in average second semester marks assigned by teachers 
tend to be more closely related to the average ability level of 
their students than do the individual differences in first semester 
average marks* Again* the in-service training program cannot 
be tied to this difference in a causal manner but the nature of 
the change is consistent with one of the primary objectives of 
the program* viz* to make teacher *8 standards more sensitive to 
the ability levels of the groups they teach. It should be noted 
that the increase in relationship between average marks and average 
IQ did not result in an extensive change in the individual differ- 
ences In average marks since the correlation between average marks 
for the two semesters (N»31) is *82* 

Table 20 

Means and Standard Deviations of 
Average Reported Marks 
Second Semester 







1st 
6 Wks 


2nd 
6 Wks 


3rd 
6 Wks 


Sem* 

Exam 


Sem, 

Mark 


School A 
(W=17) 


M 

SD 


7.8 

le4 


7.6 

1.5 


7.8 

1.3 


6.8 

1.8 


• 7.5 
1.3 


School B 
(N=17) 


M 

SD 


6.6 

1.5 


6.1 

1.7 


6.8 

1.3 


5.8 

1.4 


6.4 

1.3 


Total 

(N=34) 


M 

SD 


7.3 

1.5 


6.6 

1.8 


7.3 

1.4 


6.3 

1.6 


7.0 

14 








The correlations among the reported second semester marks 
and scores were obtained for all teachers with at least 15 
students having eoog>lete data. The correlation matrices for the 
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21|. teachers meeting this criterion are given in Appendix E. 

The correlations between and final second semester mark have 
been abstracted from these matrices and are summarized in Table 21. 
The corresponding summary for the first semester data As in 
Tabio ll^. The average correlation In School B Is but the 

variability from teacher to teacher is less. This is consistent 
with the first semester data. However, comparing across semesters, 
we find the average correlation In both schools slightly lower 
for the second semester. The variability in School A Increased 
and the variability in School B decreased slightly during the 
second semester. The change in the average correlation for both 
schools combined is so small { .03) that, for practical purposes, ’ 
the average correlations for the first and second semesters may 
be CMisldered equal. It is apparent from these data that, regard* 
less of changes on the part of individual teachers, the over*all 
picture is one of no change. The intact of the in-sorvice program 
on the average IQ-final mark correlation is therefore negligable. 

The multiple regression analysis performed on the first 
semester final marks was repeated with second semester marks . 
Regression equations were derived for each teacher in the predic- 
tion of final marks from the three six-week period marks and the 
semester exam mark. The results are given in Table 22 in terms 



of the final mark variance accounted for by each of the predictors. 



The averages for the combined groups Indicate that the semester 
narks account for almost one-third of the variance while the third 
six-week marks account for about 28 percent. The first and second 
period marks each account for slightly less then 20 percent of the 
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Table 21 



Distribution of Correlations of Otis 10 

Wlllll} jSAfltAmi 

— ==? r=r^ ^ ww^-w ^ eaoM BLO. 



.90 

.85 

.80 

.75 

.70 

.65 

.60 

.55 

.50 

45 

40 

.35 

.30 

.25 

.20 

.15 

.10 

.05 

.00 

.05 

.10 

.15 



School A 



1 

1 

1 



1 

1 



1 

1 

1 



1 

1 



13 

.33 

.30 



School B 



1 

1 

1 

2 

1 

1 

1 

2 



11 

43 

.4 






Total 



2 

1 

2 

2 

1 

3 

1 

3 

1 



2 

1 

1 



1 

1 



1 

.25 












Table 22 




Teacher 

Niunher 




Pareent of Variance in Second Semester 
Harks Accounted for by 
Period c^d Semester Exam Marks 



SiX'Vtesk Period 
1 2 ? 


SeniAS^.AM 

l^am 


29 


k 


26 


37 


8 


18 


25 


k6 


16 


16 


30 


3k 


7 


26 


25 


35 


17 


23 


13 


k6 


Uf. 


k 


kk 


32 


12 


1 


^2 


k2 


9 


27 


38 


25 


19 


22 


19 


36 


5 

21 


r 5 
10 




53 

k8 


11 


..-6 


51 


42 


7 


'45 


27 


19 


12 


Ik 


30 


32 


21 


3 


kg 


28 


29 


29 


. 15 


25 


26 


17 


21 


33 


3k 


28 


Ik 


2k 


21 


31 


17 


30 


18 


26. 


20 


3k 


10 


38 


20 


19 


18 


Ik- 


32 


35 


36 


- 7 


35 


25 


. 15 


22 


25 


35 


27 


2k 


Ik 


32 


13 


7 


27 


51 


23 


30 


20 


26 


30 


11 


36 


17 


3k 


0 


22 


33 


6 


23 


39 


31 


4 


10 


62 


23 


22 


15 


12 


kl 


8 


22 


20 


k7 


33 


k5 


22 


- 2 



M V/.VCiA 



96 

97 
96 
95 
99 
9k 

95 
99 

96 

97 

97 

96 

98 
88 

97 
98. 

97 
100 
•99 

98 
87 

99 
89 
97 

97 

98 

99 

89 
99 
99 

90 

97 

98 







Mean (A) 16 15 30 

Mean (B) 21 20 26 

Mean (Total) 18 17 28 



36 

30 

33 



97 

97 

96 



r 



I 
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vapianc6« This outcons Is vsry sinilar to the results for the 
first semester (see Table I5).» the only difference being that 
slightly more variance is being predicted by the final exam 

e 

and slightly less is being predicted by the second period marks. 

The average total variance accounted for is the same in both 
semesters. 

These statements refer to average findings and, of course, 
changes at the individual teacher level tend to be obscured by 
such averages. Significant changes by individuals (e.g. Teachers 
12, 33, and 48) did occur but it is difficult to ascertain whether 
such changes reflect radically different practices consciously 
adopted by the teachers or "chance" differences in the pattern 

of correlations among the six-week period and final exam marks. 

* \ 

Marking Exercise (Form B) 

• -** 

The second Marking Exercise was administered during the last 
weeks of the second semester* Since the in*service program 

• . • I 

had concluded, the materials were left in each teacher's mailbox - 

with a request to complete and return the exercises prior to the 
end of the semester. This request unfortunately came at a time 
when most teachers were under great time pressure due to special 
end-of-the-year activities and events, final examinations, etc. 

Despite two follow-up requests during the final two weeks of the i 

term only 23 (15 from School A and 8 fro^ School B) completed 
copies of the Marking Exercise were returned. This, in combination 
with differences inherent in the two forms, make it virtually im- 
possible to make direct comparisons between the data collected on 
the two occasions. The distributions of assigned marks for Form B 
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are presented In Table 23. As with Form A, these data clearly 

* • « 
show that fairly consistent discriminations are being made between 

students. However, the Pom B intraclass correlation of .69 is 

appreciably lower than the .80 obtained for Perm A. This difference 

may reflect sampling error in the two. groups completing the two 

f orms or it may be attributed to differences in the two forms 

themselves (see Appendix C)« 



Table 23 



Distribution of Assigned 
Marks for Marking Exercise (Form B) 



Student 
Number . 


F 


D- D 


D+ 


C- 


# 

C 


0+ 


B- B 


B+ 


A- 


A 


A+ M 


1 




1 


1 




15 


2 


1 3 








6.4 


2 

A 














2 16 


1 


1 


3 


9.4 


3 










1 




2 15 


1 


2 


2 


9.3 






2 


1 


2 


16 


1 


1 








5.7 


5 










11 


5 


6 1 








6.9 


6 




1 




1 


4 


3 


1 3 








6.4 


7 




5 




5 


12 


1 










5.2 


8 




1 2 


2 


1 


15 




1 1 








5.6 


9 




8 


3 


k 


7 




1 








4.6 


10 










1 


1 


2 16 


2 


1 




8.9 


. 11 


1 






2 


4 












3.6 .. 


12 


3 


5 11 


2 


1 


1 












2.8 


13 


2 


2 .15 




3 


1 












3.1 




1 


11 


2 


3 


6 












4.0 


l5 












2 


19 


1 


1 




9.0 


16 




9 


2 


3 


8 


1 










4.6 


17 


2 . 


15 


1 


1 


4 












3.5 


16 


2 


1 12 


1 


2 


4 




1 








3.8 


19 




h 


3 


0 


7 




1 








5.0 


20 


- 


• 








1 


2 14 


1 


2 


3 


9.4 


The fact 


♦ 

that Form B 


is 


’’harder” 


(in the 


sense 


that 


scores 



14 

1.1 

1.3 

1.1 

.9 

1.3 

1.2 

1.5 

1.5 

.9 

1.3 

1.2 

1.2 

14 

14 

i.i 

14 

1.3 



are systematically reduced on five of the seven classrom perform, 
ance variables) is clearly reflected in the mean marks assigned 
on Form B. The average mark for every one of the 20 students is 
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less than the corresponding average for Form A. The grand mean 
for all. marks. on Form A la 7.3 as compared vith 5.9 for Form B. 

This finding has one obvlovs Implication - the teachers gave 

an absolute rather than _ 

*..voipi-ecacion of the magnitude 

of the classroom performance scores. That is, the 0-100 score 
scale used in the exercises was treated as if it represents mean- 
ingful units Which could be interpreted without reference to the 
performance of the group. The absolute interpretation undoubtedly 
represents a carry-over from th^ system where 93-lO0=A. 85.92 =b, 
etc. The fallacy of absolute Interpretation of scores was discussed 
in the in-service program but this apparantly had little impact 
upon the teacher's actual behavior. Perhaps this can be partially 
explained by the general absence of nusJeric data- when the teachers 
asslf^ marks to their own students, whore numeric data are not 
employed, it is difficult for teachers to see the need for using 
b«ls descriptive statistics in order to interpret test and quiz 
results. The long-term habits established under these conditions 
were evidently unaffected by the in-service training. 

The multiple regression analysis was repeated on the Form B 
data for each teacher. Table Zk shows the percent of variance in 
assigned marks attributable to each of the seven classroom scores. 

The average total percent of variance accounted for is 90S? as 
opposed to 95^ for Form A. The general reduction in the scores 
may have forced some teachers to rely more upon biographical data 
to avoid assignment of marks which they consider unduly low. Had 
the smsples been identical for the two forms and had each teacher 
omployed.the same, msthod on both occasions, we would expect Table 2 ^ 
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I 

i 

I to be a rearrangement of the columns in Table 17 corresponding 

i \ 

I to the shifting of variables in Form A to construct Form B. 

t 

4 

jT 

1 • ... 

j Table 2k. 

i . • 

i _ . * — - .... 



Percent of variance in Assigned 
Harks Accounted for by the Seven 
Scores in Marking Exercise B 



I.D. 




Quiz Number 


3 Wk 


6 Wk 


Homework 


Total 


No. 


1 


2 


3 


kr 


Test 


Test 


Average 




1 


27 


- 2 


- k 


12 


7 


2k 


- 6 


58 


2 


38 


-15 


•• 2 


7 


21 


25 


10 


84 


6 


- 5 


-11 


10 


12 


Ilf 


21 


57 


, 98 


1 


13 


- 1 


- 8 


.6 


39 


36 


6 


9k 


8 


11 


10 


8 


2 


33 


13 


11 


88 


9 . 


32 


- 6 


12 


111- 


13 


19 


7 


91 


10 


- 3 


5 


50 


17 


- 2 


- 1 


26 


. 92 


11 


- 2 


22 


- l|. 


1 


9 


17 


50 


93 


12 


11 


-5 


21 


11 


26 


10 


14 


88 


13 


19 


8 


5 


8 


0 


0 


56 


96 


16 


32 


- 6 


12 


li^ 


13 


19 


7 


91 


17 


10 


-10 


12 


k 


lf5 


5 


21 


87 


18 




*•11 


6 


- 5 


15 


23 


24 


86 


20 


16 


6 


13 


5 


5 


27 


9 


81 


21 


5 


- 5 


22 


k 


Ifi 


.21 


10 


98 


30 


6 


20 


18 


- 2 


31 


17 


4 


94 


32 


61 


3 




6 


6 


10 


9 


99 




• 3 


- k 


- 2 


ll- 


38 


11 


47 


91 


% 


18 


11 


15 


111. 


3 


10 


26 


97 


35 


•» 2 


-13 


1 


2 


19 


2 


48 


57 


36 


39 


- 8 


23 


7 


6 


19 


- 6 


80 




23 


-11 


26 


13 


6 


21 


21 


99 


k5 ■ 


25 


- 7 


29 


^ 12 


17 


5 


16 

• 


97 


Mean 


17.6 


> -1. 


3 11. 


8 7.3 


17.6 


• 15.3 


. 20.3 


88.6 






This expectation is houghly borne out if we look at the 
column means for the quia scores. The ordering of the four quizzes 
is exactly what would be predicted from the results of Form A, e.g. 
the first quiz in Form B accounts for an average l8 percent as 
compared with 22 percent (as the fourth quiz) in Form A« etc. 

One unexpected outcome is that for the second quiz idiere the 
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average percent of variance la actually negative. This quiz 
consistently partials out variance In assigned marks when com- 
bined with the other six scores. This is probably . related to the 

— t — ii«« a avox'tn^o oorrexauioii wit:n the other 

six variables but has a small standard deviation. The author can 

give no satisfactory explanation of the difference between Form A 
and B for this quiz. 

The variance attributable to the test , six*week exam, and 
homework average is also very similar to what would be expected 
even though many teachhrs gave differential weighting to these 
scores* The three-week test accounts for 18 percent (as opposed 
to 21 percent as the six-week test in A) , the six-week test forf 
l5 percent (as opposed to 11 as the homework average in A), and 
the homework accoi^nts for 20 (compared with 16 as the three-week 

I ^ 

test in A). The ineffectiveness of differential weighting of raw 
scores is clearly Illustrated by these data. 

The average marks assigned on Form B correlate .25 with 
average marks assigned on Form A (N=23)' and .01 with average final 
marks assigned for the second semester (W=l8). There is a weak 
tendency for differences in standards to be consistent on the two 
exercises but no consistency between standards on the exercise and 
in the classroom. The latter result was also found with Form A* 
Markin^;^ Questionnaire Data (Time ^ 

The second administration of the Marking Questionnaire was 
handled in the s^e way as the administration of Form B of the 
Marking Exercise. Due to factors previously raentloned, the percent 
of completed questionnaires returned was disappointingly low. 
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A total of 28 (17 from School A and 11 from School B) con^leted 
questionnaires were returned and the response frequencies for 
each Item were converted into proportions* Hhese proportions 
are gl^en Item by item In Appendix B. The high attrition rate 
makes It impossible to draw direct comparisons between the Time 1 
and Time 2 data. To facilitate such comparison the Time 1 data 
for only the 28 Time 2 respondents were used to coo^>ute new 
proportions. These data and a brief discussion of them are 
presented In Appendix B. 
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SUMHABY ASD CONCLUSIONS 



I 



The data presented in this report were collected to answer 
cwo general questioner First , tdiat is the nature and magnitude 
of individual differences among secondary school teachers with 
respect to: 

(1) narks assigned on a variety of levels 
(daily work » quizzes, major tests, six- 
week and total semester reporting periods), 

(2) marks assigned on a standardized marking 
exercise, and 

(3) self-reported marking practices? 

. . .» 

Second, to what extent are the individual differences mentioned 
above amenable to change as a result of participation in a con- 
centrated in-service program on marking practicos* 

The first question is regarded as most crucial to an under- 
standing of the marking process whereas the second is most rele- 
vant to an assessment of the effects of intervention upon this 
process* Two limitations of the study restrict the generalize- 

i 

bllity of the findings: (a) the sample consists of only 38 

teachers (one elass/teacher) from two different schools, and 
(b) no control group was employed. The absence of a control group 
means that statements concerning the impact of the in-service 
training experience are made on the assiuaption that no consistent 
shifts in marking practices occur between the first and second 

'• . I 

semester under "normal" -circumstances • 

The major findings are summarized below. 

9 

(1) The average marks on quizzes, and daily work 
are higher than on six-week tests with marks 



I 





> 









'i' 

& 






I 



. 






I , 
X 






* I 
i I 




on both types of performance somewhat I 

lower following the in-service training, \ 

The variability in average marks on I 

quizzes and dally work is greater than S 

on six-week tests with a slight increase i 

in variability on both following the 
training. 



(2) The average marks reported for the six- 
week and total semester periods are 
substantially higher than average semester ^ 
examination marks both prior to and follow- 
ing the in-service progrsua* The average 
reporting period and semester exam marks are 
slightly lower and more variable following 
the program. 



(3) The correlation of average semester marks 
and average class IQ prior to the program 
is somewhat lower than following the pro- 
gram (.57 and .66, respectively). The 
correlation of average marks for the two 
different semesters is .82* 



»» • 



(i|.) The mean correlation between semester meu^ks 
and IQ is the same before and after the 
program (.I|.l and .38, respectively) with 
great variation from class to class on both 
occasions. The correlations range from -«10 
to .70 before and from '-.15 to .90 after 
the training sessions* 

(5) Approximately 95 percent of the variance 
in semester marks is accounted for by six- 
week and semester exam marks. Semester 
exam marks account for more variance than 
do six-week marks in most cases. Marks 
for the third six-weeks period generally 
account for more variance than do marks . for 
the first and second periods. These results 
were found both before and after the in- 
service training. Great variation from 
teacher to teacher was also found (see 
Tables 15 and 22) • 










(6) Substantial inter-teacher agreement is 
found in the marks assigned on a stand- 
ardized Harking Exercise, The intraclass 
correlation is »8o for Form A (prior to 
training) and .69 for Form B (following 
training). No statement of change is 
possible since the ”pre” and "post" 
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sasople? were so dif:T:eren1>: due to 
attrition on Form B* However, the 
range of marks assigned individual 
students is great on both Fornis A 
and B (:Trom F to C for the most 
es:treme student on both forms) • 

The average marks assigned on Form A 
are substantially higher than Fprm. B /. 

(the latter havi^ lower scores than 
the former) and the correlation of 
average marks assigned on bhe two forms 
of the standard exercise is .25 • The 
correlations of these averages with 
average marks given in the classroom 
is substantially zero. 

The percent of variance in marks 
assigned on the standard exercises is 
generally predictable from the luiown 
characteristics (variances and .'Inter- 
correlations) of the scores given in 
the exercises. 

There is great variation in self-, 
reported marking practices both before 
and after the in-service training. 

There is no appreciable tendency 
towards greater concensus on most 
practices following the program. 

The above statements provide a basis for several general 

t 

conclusions about the marking process as it was studied and 
analyzed in this investigation. 

First, the standards en^loyed by teachers differ from one 
type of performance to the next with generally higher standards 
used on major tests and examinations than on daily work anc 
quizzes. The standards which are employed appear to be subject 
to change although the change is not great in the present study. 

Second, teachers show some sensitivity to general ability 
level within a class in assigning marks. This is manifested in 
a moderate positive relationship between average IQ and average 



( 9 ) 
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mark* This sensitivity to between groups ability level appears 
to have been io/^reased by the in-service program* 

Thirdt despite the sensitivity to class ability level, 
a small part of the variance in marking standards appears to 
represent generalized marking habits (average marks assigned 
on different standard marking exercises show a low positive 
correlation) yet this does not generalized from an artificial 
situation to actual -classroom marks ^ 

Fourth, teachers assign marks largely in terms of absolute 
standards of pe>jfformance and show little awareness of the relative 
difficulty level ^d dlscriminabillty of the performances upon 
which they base thhir marks. Since marks for the third six-weeks 
and semester exaA typically have greater variability, these carry 

■ f 

more weight In the determination of semester marks than do marks 
for the first and second six-weeks periods. 

Fifth, most teachers apparently assign marks according to a 
global evaluative Judgmental process which me^ or may not he 
related to objectively measured ability. The correlations among 
the marks assigned by an individual teacher for different periods 
and on the semester exam are uniformly high and yet the correlation 
of marks with IQ fluctuates radically from teacher to teacher. 



(This latter fluctuation can be only partially explained by 
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differences in class ability levels.) The Judgmental process by 

.which marks are assigned is relatively immune to special training. 

Finally, there are great individual differences in all 

facets of the marking process. These differences should not be 

ignored for they are often as ing>ortant as the general findings 
outlined above* 
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Appendix A 

Outline and Description of 
Materials Used In* the In-Service 
Training Program 
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Outline of In-Service Training Program 



Sessiotu S< 



•introduction 

A* Testing— First administration of Marking 

Questionnaire and distribution of 
Marking Exercise A 

B. General discussion of the natui’e and objectives 
of the in-service program 

Session II, Importance of School Harks 

A. Necessity for evaluation 

B, Uses of marks 

0. Inqpact of marks upon the student 
D* Need to make marks relevant 



Session III, 



Session IV, 



Measurement and< school marks 

A, Definition of measurement 

B, Special problems in psychological measurement 
V*, Technical characteristics necessary in 

measurement 

1, standardization of procedure 

2, objectivity in scoring ’ 

3 , reliability 
t, validity 

D, Distinction between measurement and evaluation 

E, Need to base evaluation upon measurement 

Approaches to classroom measurement 

A, Types of format 

1, free-response items 

2 , choice items 

B, Types of scoring 

1* objective 
2, subjective 

C, Purposes of classroom measurement 

1* diagnosis 

2, assessing mastery 

3* assessing general achievement 

D, General achievement tests and marking 

E, Non-test approaches 

!• classroom performance measures 
Zm non-classroom performanoe 
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Session V. Describing achievement scores''statistieeXl 7 

A. Frequency distributions (construction and 
sn&pes ) 

B. Percentile's and percentile ranks 
Co Central tendency (mean and median) 

D. V^iability (Q and SD) 

i!»'a Item analysis techniques 

P. Item characteristics and test scores 

Session VI, Translating measures of achievement into marks 

n* and non-achievement factors 

B* Objectivity and mai^ks 

Session VII* Different bases for marking 

A* Ability and achie\cment 
B* Self-lnmrovement or growth 
C* The notion of absolute standards 
Do Achievement with reference to others 

Session VIII, General achievement measures and variability 

B* discrimination 

• Variability as an index of relative weisht 
when scores are added over tests 

The in-service sessions lasted approximately one hour and 
were held in a classroom at each school immediately following the 
dismissal of school for the day. Detailed notes and supplementary 
materials for each session were typed, reproduced, and distributed 
to each participant. Each teacher was also given an Inexpensive 
notebook cover in which a cumulative record of all the prepared 
materials was kept. Approximately 75 pages of such notes were 
given out during the eight sessions. In addition, all participants 
were given a con5>lete Tests md Measurements Kit published by the 
Educational Testing Service. Selected readings on test construc- 
tion and descriptive statistics were assigned in these references 
and discussed during the training sessions* 
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The Marking Questionnaire was adiialnlstered during the 
first in-service session end again during the final three weeks 



I of the second semester. Table E. 1 shows the percent responding 

I to each option for all questions in Part II for the M teachers 

j responding on the first administration and, 2^60 teachers in a 

previous national survey by Terwllllger (1966). The latter 
I teachers are all teachers In the academic areas (Foreign language, 

j language Arts, Mathematics, Science, and Social Studies) out of 

I ^ total of 1},000 teachers who responded In the survey. The 

i 

I survey date provides a convenient set of "norms" against lAiieh 

! data from the present study may be compared, fttems where the 

I percents do not sum to 100 were left blank by some teachers.) 

There are no striking differences between the two sets of 
j data if one considers the possibility of san5>ling error In the 

j relatively small sample In the present study. There Is great 

I variability in the response to almost every item In both sets 

of data. The only issues on idiich there is considerable agree- 
ment concern the use of weighting formulas (over 90 percent 
don't use formulas) and the consideration given to final exams 
I (most teachers endorsed "moderate consideration"). There Is also 

I general agreement among the kl Nashville teachers on consideration 

given to work in previous marking periods (71 percent do not 
consider previous work at all) and relative consideration given 
to each marking period In assigning final marks (80 percent give 
equal consideration to all periods). These self-reports are 
Interesting when compared with the .‘esults In Tables 15 and 17. 
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Table B 1 



Percent Responding to 
Each Question on First Administration 
and for Con^arison Data 



2tem 



Time 1 (N=di.l) 

“TT ^ 



15 r 



Comparison (N>2U60) 

T h C ^ E“ 



9 

1C 

11 

12 

13 

Ik 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 



46 

66 

2 


29 

29 

98 


15 


5 5. 

/ 


28 

57 

8 


38 

43 

92 


27 


7 


20 


44 


31 


5 


29 


47 


21 


4 


6 


46 

37 


24 


15 


21 


44 


25 

% 


9 


7 


39 


15 


5 


31 


19 


2 


22 


52 


22 


6 


30 


46 


15 


2 


27 


49 


17 


7 


14 


50 


Z 1 


0 . 


0 


30 


68 


6 


1 


22 


76 


5 


22 


37 


34 


5 


35 


42 


18 


71 


17 


7 


0 


53 


27 


12 


8 


0 


2 


93 


5 


4 


9 


63 


23 


}l 


17 


44 


22 


10 


37 


43 


10 


}‘q 


49 


31 


5 


(22*24 not included 


49 

2 


32 

10 


J7 

80 


0 

6 


(in survey question- 
(nalre 



Table B 2 gives comparable item response data for the 
28 teachers who answered the questionnaire on both administrations. 
The loft side of the table gives time 1 data and the right side, 
time 2. In general, the results are highly similar on the two 
administrations* The only items suggesting change are those 
dealing with homework (less consideration, time 2>, term papers, 
etc. (more consideration, time 2), and standardised tost results 
(less consideration, time 2). None of these changes can be 
attributed to the program because these issues were not dealt 
with directly in the training sessions. 
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Table B Z 

^Percent Responding to Each 
Question for Only Subjects Who Cosg>leted 
the Questionnalx'd TIfb 1 and 2 

(Ns28) 



Time 1 



Time 2 



6h 



Item 


7T 


—r 


0 


“ir^ 


~T 


A 


B 


c 




T*- 


9 




27 


18 


9 


0 


50 


25 


21 


4* 


0 


10 


64. 


27 








71 


25 








11 


9 


91 








11 


89 








12 


27 


46 


27 


0 




28 


61 


11 


Q 




13 


9 




27 


9 




32 


46 


22 


0 • 






9 


4^6 


27 


9 




11 






4 , 




15 


0 


22 


27 


^2 




4^ 


28 


57 


11 


• 


16 


0 


18 


65 


Id 




0 


21 


61 


18 




17 


0 


0 


9 


83 




0 


4 


18 


78 




18 


0 


37 


27 


2? 




0 


43 


46 


11 




19 


73 


9 


9 


0 




78 


Ik 


8 


0 




20 


0 


0 


100 


0 




0 


0 


75 


25 




21 


27 


27 


37 


9 




7 


32 


SO 


11 




22 


§2 


55 


18 


0 




21 


54 


25 


0 




23 


55 


45 


0 


0 




62 


18 


. 0 


0 


, 


2k 


0 


9 


91 


0 




0 
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96 


0 
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Parc II 



Marking FracCicea 



The follo^ins questions are designed to obtain information about prac- 
tices you etApIoy in assigning marks to students, we specifically vant to 
know about practices used in the course ^ich you named on the previous 
page. Please keep that course in 'mind as you answer the following questions. 
Respond by circling the letter corresponding to the ansvier which Is most 
descriptive for you. (Circle only one answer for each item.) 



9. 



llhich of the following best represents the primary basis which you 
use in determining the marks of your students? 



a. 

b. 

c. 

d. 

e. 



absolute achievement 
achievement with respect to ability 
achievement with respect to the class 
self-improvement or growth 
other (please specify) 



19. Do you use some kind of formula to weight the factors (hcoework, 
tests, etc.; which you consider in assigning marks? 



a. yes 

b. no 

If yes, please write the formula. 



11. Do you assign marks to appronlmate some predetermined distribution, 
e.g., 5%A's, 15% B's, etc.? 



a. yes 

b. no 

If so, please describe the distribution you use. 



Questioiis 12-19 concern consideration you give to various factors 
in determining marks for each regular six weeks marking period . 



12. VIhat consideration do you give to classroom behavior (e.g., causing 
distractions or conversely being very cooperative) in determining 
course marks? 



a. 

b. 

c. 

d. 



no consideration at all (0%) 
minor consideration (1-107.) 
moderate consideration (11«*25%) 
major consideration (26-99%) 
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13, IJhat consideration do you give to unexcused absence and tardiness in 
determining merles? 



a. no consideration at all (0%) 

b. minor consideration (1»10%) 

c. moderate consideration (11-25%) 

d. major consideration (26-99%) 

14 • 1‘Jhat consideration do you give to "effort” in assigning marks? 

a. no consideration at all (0%) 

b. minor consideration (1-10%) 

c. moderate consideration (11-25%) 

d. major consideration (26-99%) 

15 • ^at consideration do you give to homeuork in determining marks? 

a. no consideration at all (0%) 

b. minor consideration (1-10%) 

c. moderate consideration (11-25%) 

d. major consideration (iS-99%) 

16. What consideration do you give quiz, (less than 15 minutes) scores in 
determining marks? 

a. no consideration at all (0%) 

b. miner consideration (1-10%) 

c. moderate consideration (11-25%) 

d. major consideration (26-99%) 

17. W.at consideration do you give to test (up to one class period) scores 
in assigning xoarks? 

a. no consideration a^ all (0%) 

b. miner consideration (1-10%) 

c. moderate consideration (11-25%) 

d. major consideration (26-99%) 

18. What consideration do you give to classroom performance (i.e., recita- 
tion, voluntary participation, etc.) in determining marks? 




19. 



a. no consideration at all (0%) 

b. minor consideration (1-10%) 

c. moderate consideration (15. *25%) 

d. major consideration (26-99%) 

What consideration do you give to ^ork done in previous marking periods 
when assigning marks for a period just ended (e.g., to uhat extent do 
marks givr^n for the second period represent work done during the first 
period)? 

a. no consideration at all (0%) 

b. minor consideration (1-10%) 

c. moderate consideration (11-25%) 

d. major consideration (26-100%) 
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Questions 20-24 refer to consiueration you give to factors in deter- 
mining final seines ter marks . 

20. Iftiat consideration do you give to final examinations (end of semester) 
in detemining final marks? 

a. no consideration at all (OZ) 

b. minor consideration (1-10%) 

c. moderate consideration (11-25%) 

d. major consideration (26-100%) 

21. IJhat consideration do you give to other assigned work (term papers, 

individual projects, etc.) in determining final narks? 

a. no consideration at all (0%) 

b. minor consideration (1-10%) 

e. moderate consideration (11-25%) 
d. major consideration (26-100%) 

22. I'Jhat consideration do you give to "aiake-up** or "extra-credit" work 
voluntarily done by students? 

a. no consideration at all (0%) 

b. minor consideration (1-10%) 

c. moderate consideration (11-25%) 
d« mojor consideration (26-100%) 

23. IJhat consideration do you give to s tandardized test results (ability 
or achievement measures) in determining final marks? 

a. no consideration at all (0%) 

b. minor consideration (1-10%) 

c. moderate consideration (11-25%) 

d. major consideration (26-100%) 

24. Indicate the relative consideration which is given to work done in 
each marking period when you assign final marks. 

a. more oonsideratlon is given to work done in earlier periods 
(e.g., first six weeks) 

b. more consideration is given to work done in later periods (e.g., 
last si:: weelcs) 

c. e {ual consideration is given to work done in all marking periods. 

d. other (specify) 
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SA 


A 


U 


D 


SD 


25. Students viho are not concerned about marks are 
unrealistic . 


SA 


A 


U 


D 


SD 


26. The most important factors in determining marks 
can only be judged subjectively. 


SA 


A 


U 


D 


SD 


27. Objective type e:saminations accurately assess 
the more important types of learning. 


SA 


A 


IT 


D 


SD 


28. Marks should be based upon fired standards which 
a teacher maintains irrespective of how students 
perform. 


SA 


A 


U 


D 


SD 


29. School marks represent a system of reward and 
punishment id&icb does more harm than good. 


SA 


A 


u 


D 


SD 


30. '^Social promotion*' is more desirable than fail- 
ing students with limited ability. 


SA 


A 


u 


D 


SD 


31. A teacher should not consider other demands on 
student time (involvement in athletics, school 
organizations, after-school jobs, etc.) when 
assigning marks. 


SA 


A 


u 


D 


SD 


32. Students should not be allowed to do special make- 
up extra-credit work ic order to raise their narks. 


SA 


A 


u 


D 


SD 


33. Students and their parents attach too much 
importance to marks. 


SA 


A 


u 


D 


SD 


34. "Effort" should not be considered in assigning 
narks to students. 


SA 


A 


u 


D 


SD 


35. The more important achievements of students can 
be measured quantitatively. 


SA 


A 


u 


D 


SD 


36. More important types of learning can be evaluated 
only by subjectively scored (essay) tests. 


SA 


A 


u 


D 


SD 


37. Marks should be based upon the relative levels of 
achievement among students in a class. 


SA 


A 


u 


D 


SD 


38. Course marks should not be lowered for discipli- 
nary reasons. 


SA 


A 


u 


T> 


SD 


39. A teacher should consider student home environ- 
ment (parents income and education, whether 
parents are divorced, etc.) when assigning marks. 


SA 


A 


u 


0 


SD 


40. Assigning marks is one of the most distasteful 



aspects o£ teaching. 



i ) 
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SA 


A 


U 


D 


SD 


41. 


SA 


A 


U 


D 


SD 


42. 


SA 


A 


u 


D 


SD 


43. 


SA 


A 


u 


D 


SD 


44. 


SA 


A 


u 


D 


SD 


45. 


SA 


A 


u 


D 


SD 


46. 


SA 


A 


D 


D 


SD 


47. 


SA 


A 


U 


D 


SD 


48. 


SA 


A 


U 


D 


SD 


49. 


SA 


A 


U 


D 


SD 


50. 


SA 


A 


U 


D 


SD 


51. 


SA 


A 


U 


D 


SD 


52. 


SA 


A 


U 


D 


SD 


53. 


SA 


A 


u 


D 


SD 


54. 



laarlc he makes. 

The assigmaeiit of marks to students is, at best, 
a nec v^sary evil. 

Differences in the natural ability of students 
should be considered in assigning school narks. 

A good teacher can tell ho\r much a student has 
learned without giving vritten tests. 

Classroom deportment (causing distractions, etc 
should be reflected in subject natter narks. 

Marks should be assigned to approximate sone pr< 
determined distribution, e.g., 5% A's, 15%B*s, 
etc. 

Competition among students for good narks is a 
healthy thing. 

The more important outcomes of an education are 
reflected by school marks. 

Our schools vould not be better off if narks 
oere abolished. 

Marks should be based primarily upon the teache 
evaluation of student progress or growth. 



room through discussion and voluntary participa- 
tion should not be considered in assigning marks. 



failure of the teacher as the student. 

Some students nay fail in spite of the 
the teachi^. 

Marks should be based solely upon teacl 
tests and other written work. 
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Appandjlx C 

V 

Hacking Esorcises 
A and B 
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Th* two fe jia of the Marking Exerciae en^loyed In the 
present study were designed as vehicles for the Investigation 
of marking practices under well-controlled and standardized 
conditions. Every attei^t was made to make the exercises both, 
realistic and Interesting to the teachers. 

Pom A was designed several years ago and has been used 
in other research. The blogrpphlcal data developed for each 
student were designed to give a life-like, integrated and 
consistent description. The classroom quiz, test, and homework 
scores were also structured so as to be both realistic and 
consistent. The means, standard deviations, and correlations 
among the seven classroom performance scores are given below. 





. Quiz Ikuilber 
1 2 3 1. 


Table C 1 
3 Wk 
Test 


Q 1 
u 2 
1 3 
z k 


.53 — 
.80 .1,5 
.54 .61 


.62 — — 


* " O ^ 


3 Wk 
Test 


.30 .36 


.75 .67 


— 


6 Wk 
Test 


.59 .49 


.61 .59 


.41 


HomeKork 

Average 


.61 .41 


.66 .43 


.55 


Mean 

SD 


16.4 69.8 

13.4 11.3 


89.2 70.0 
3.8 19.0 


79.9 

9.6 




.38 



86.4 

6.6 



92.8 

i|Le6 
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Form B waa derived frtM Form A in the following way: 

!• namea and the wording of the biographical 
descriptions were changed but the sex^ IQ^ 
and general personality traits of each 
student were i^etained 

2. slight modifications were made in the absence 
and tardiness figures 

3. quiz scores were altered and/or shifted as 
below 

a. 1st week quiz scores were shifted 
to the 4th week quiz 

b. five was subtracted from each 2nd 
week quiz score and these scores 
were shifted to the 5th week quiz 

c. four was subtracted from each 4th 
week quiz score and these scores 
were shifted to the 2nd week quiz 

d« six was subtracted frmn each 5th 
week quiz score and these scores 
were shifted to the 1st week quiz 

4* test, exam ^d homework average scores were 
altered and/or changed as below 

a. three-week test scores were shifted 
to the homework average 

b. ten was subtracted from each six- 
week exam score and these scores were 
shifted to the three-week test 



c. eight was subtracted from each homework 
average and these scores were shifted 
to the six-week exam 



The alterations involving the quiz, test, six-week exam, 
and homework data systematically reduce the means by the constants 



subtracted but, of course, change neither the variances nor the 
relationships among the variables • Shigting the variables about 



singly yields a different permutation of variances for specific 
quizzes and tests, e.g. the 1st quiz is now the variable with 
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the greatest variaiioe, Thei^efore^ the means » standard deviations, 
and correlations given for Form A also describe Form B if 
appropriate changes in means ahd variable names are made. 
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Marking Exercise 



The attached pages contain brief biographical descriptions of twenty 
hypothetical students. These descriptions include each student's name, 
an X«Q. score (in parentheses following name) and selected information 
concerning classroom behavior, general academic performance and extra- 
curricular activities. Miscellaneous observations are also provided for 
most students. 

These twenty students have just completed a six-weeks period in a class 
together. The final page contains attendance data and quiz, examination 
and home work marks for each student. Weekly quizzes were given at the end 
of the first, second, fourth and fifth weeks. A mid-period test was given 
at the end of the third week and a com;^rehensive examination v^as given at 
the end of the six-weeks period. The home work mark is an average for all 
work during the six weeks period. The marks which have been recorded are 
based upon a 0-100 scale. 

You are to assign six weeks marks to each student using both a 0-100 
scale and a marking system used by your own school. (For example, if you 
assign a student a mark of 94 and 93-100 is the range designated as "A" at 
your school, you would also give the student an "A.") 

Mark these students just as you would mark students in your own classes 
insofar as this is possible with the information which you have been given. 
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1. Wiliiam Allen (120) 



Classroom Behavior: Steady performance in subjects which interest 

him. Almost no effort expended in less 
interesting subjects. 

General Academic Performance: Grades range from A*s thru C's 

and an occasional 0. 

Extracurricular: Reporter, School Newspaper, Track Team, Glee Club. 

Miscellaneous: An aggressive personality— "a fighter.” A person 

of small build who makes up for it in a "big'* 
attitude. 



2. Winifred Boynton (110) 
Classroom Behavior: 



Well prepared to participate in class— adds 
considerably to class discussion and is 
attentive listener as well. 



General Academic Performance: A very serious student with a 

straight "A" average. 

Extracurricular: No outside activities— all effort is expended 

in carrying out assignments and doing extra 
work in related subjects. 

Miscellaneous: Has few if any friends. An introverted person- 

ality. Peers characterize her as an "egghead." 

Cathryn Brinckerhoff (126) 

Classroom Behavior: Strong performer in all classes. Well 

motivated. Active class participation. 

General Academic Performance: Ranks in top 10th of class of 

200 students. 

Extracurricular: Active participator in extracurricula activities 

Editor — Yearbook 
National Society 
Class Plays 
NFL 

Miscellaneous: Respected by peers but not really well liked fay 

many because of a superiority complex Teachers 
consider student an asset to their classes. Stu- 
dent is intelligent, capable; grades come easily. 
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4. Edward Dent (99) 

Classroom Behavior: Seems to be Interested in the class content and 

participates but something is keeping this 
student from achieving to ais full capacity. 

General Academic Performance: Grades in low B*s and C's. 

Extracurricular: Track Team 

Swimming Team 

Miscellaneous: Good personality, outgoing and liked by everyone. 

5. Patricia Fischer (107) 

Classroom Behavior: Characterized by a wide variety of interests 

as well as high motivation toward academic work. 

General Academic Performance: A low ”A'* student— some ''B*s". 

Extracurricular: Secretary-Student Council 

Queen-Junior-Senior Prom 
YWCA Committee 
Glee Club 

Miscellaneous: A very attractive girl who*s '•brainy” to boot. Warm 

outgoing personality equally liked by students and 
teachers. Has ability to conceal intellectual talents 
when appropriate. 

6. Doris Gulick (111) 

Classroom Behavior: Moderate participation in class; sometimes 

appears dis in teres ted . 

General Academic Performance: Grades are divided equally among 

3* 8 and C's. 

Extracurricular: Cheer Leader 

Homecoming Queen 
Dramatics 

Miscellaneous: Student is more interested in having a good tine than 

in serious study. Student is very attractive, has 
entered several beauty contests. Very popular with 
the student body. Liked by teachers. 
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7. Elizabeth Henderson (116) 



Classroom Behavior: 



Is Interested enough In work to want to build 
a good achievement record o 



General Academic Performance: Grades mostly A*s and B*s. Grades 

come easily in some areas but student 
puts forth considerable work In 
other subjects. 



Extracurricular: 



Glee Club 
Yearbook Staff 



Miscellaneous: Has been in and out of school intermlttenly during 

the past year due to serious illness. Has attempted 
to keep up with work at home and has done rather 
'^®11 this attempt. Has had to curb extracurrlculars. 

8. Nancy Jennings (94) 

Classrocm Behavior: What is learned ais gained thru classroom 

participation. Student is well motivated but 
has little time to spend in outside preparation 
due to home situation. 

General Academic Performance: Grades mostly B*s with a scattering 

of C*s. Very little outside study. 

Extracurricular: None 



Miscellaneous : 



Mother an invalid— father works nights. Student has 
responsibility for care of five brothers and sisters, 
School activities also limited due to this factor. 
Student is mature for age. Has no close circle of 
friends. 



9. Richard Kim (92) 



Classrojm Behavior: Must work hard for everything he gets but is 

sufficiently interested in content to put 
forth the needed effort. Has very good 
organizing ability which helps him to deal 
with course content. 

General Academic Performance: Strong B student. 

Extracurricular: Editor i School Newspaper, Track Team 

Miscellaneous: Well liked by peers— a lanky, outgoing person with 

a serious side to his personality. 
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10. Frederick Lynch (132) 



Glatsrooin Bebevioir: An intelligent but reserved student. Very 

little active pirticipation in clast discussion 
but attentive to vhat is taking place. Occasion* 
ally will Bake a good point in class discuttioll. 



General Acadesic Perforsanee: Grades sioatly A's with ssse B*s. 



Extracurricular: Baseball Team 

Track Tean 

Natio^ial Eonor Society 



Miscellaneous: Quite reserved except within a close circle of friends. 



11. Irene Bason (93) 



Classroom Behavior: 



Student Is more anxious to be heard than to under- 
stand idiat 7.8 going on. Has an opinion on 
everything. Does little synthesising and there 
is tome question as to how much material has 
really sunk in. 



General Academic Performance: Primarily a B student with some C's. 



Extracurricular: Debate Team 

Speech Team 
Student Council 
Assembly Chairman 



Miscellaneous: A rather unattractive girl who hasn*'^ learned "silence 

is golden." 



12. Kenneth Michael (104) 



Classroom Behavior: Seems to be completely unaware of what is taking 

place in class. Never adds to class discussion. 
Disinterested. 



General Academic Performance: Grades mostly C's and D's with an 

occasional F. Is currently repeating 
this course due to previous failure. 



Extracurricular: None 



Miscellaneous: Has been in trouble with school authorities and is 

presently on probation. Associates with an older 
working group of boys; has been involved in some 
incidents with authorities. Gomes from broken home. 
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13. Janes Newtton (91) 

Clsssroon Behavior: Distracts iron classroon or^er by carrying on 

private conver sit ions with classmates. Is not 
aotivated except in rare instances. Then 
exhibits a spirit of activity only to fall back 
into the old pattern. 

General AcaJenic Performance: Grade range, B's and C*s. 

Extracurricular: Has ability beyond achieveoent. Has sene Interest in 

basketball but does not participate actively in any 
organisation to which he belongs » 

Miscellaneous: Has been in trouble with school authorities at times 

but is not on probation at the oonent. 



14. Dennis O'Connor (101) 

Classroom Behavior: A very shy student who never participates in class 

discussion. Is alert and attentive but never 
voices his own thoughts or opinions. 

General Academic Performance: Grades are about evenly distributed 

among B's and C's. 

Extracurricular: Interested in writing and is a frequent contributor 

to the school literary magazine. Participates in no 
teoD sports or group activities. 

Miscellaneous: Student is very conscious of a slight speech defect. 



15. David Peterson (128) 

Classroom Behavior : Performance even in all classes-well motivated. 

General Academic Performance: Straight A average. 

Extracurricular: School Debating Team 

National Honor Society 
National Forensic League 
Contributor, School Literary Magazine 
Member, Student Council 
Photographer, Yearbook 
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Miscellaneous: A model student, well liked by teachers and small 

circle of friends. 
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16. Edgar Phillips (84) 

Classroom Behavior: Tries hard but cannot gain better grasp of class 

material. Is eager to add to class discussion 
but cannot grasp the central core of ideas and 
only repeats vhat has already been said. 



General Academic Ferfoi^ances Straight C Average. 

Extracurricular: Football Team 

Miscellaneous: Nearly the largest manber of the class but well liked 

by peers. Easy going personality. 



17. Paula Ranalle (96) 

Classroom Behavior: A moderately motivated student. One \dio is more 

interested in social relations with peers than in 
a serious study. 

General Academic Performance: Grades in B's and C's. 

Extracurricular: Very gocd in dramatics and quite interested in this 

area. 

Miscellaneous: Has a good personality and is a non- conformist in a 

way— the school "character". Hell liked in the school. 



18* Judy Strang (97) 

Classroom Behavior: Student's attention is never concentrated on the 

moment. 

General Academic Performance: Primarily a B student vith some C's 

and some A's. Has quite a bit of 
native ability and interests are widely 
varied. 



Extracuirricular: Dramatics 

Preisident, Chemistry Club 
Musical Combo 
Student Council 
Yearbook Staff 





Miscellaneous: Impresses others as being scatterbrained; so many 

things going at once. Student is quite small and 
always appears busy. 
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19. Samuel Thorp (104) 



Classroom Behavior: Student nakes little Impression on anyone. 

I^ifficult to say ^at makes him "tick.** Is 
a completely neutral person. 



General Academic Performance: Grades range from A's thru C's, mostly B's. 



Extracurricular: Participates in no outside activities due to an 

after school job. 



Miscellaneous: Hone 



20. Jean Tindall (130) 

Classroom Behavior: Often makes a cogent point during class discussion. 



General Academic Performance: Grades are mostly A's with a scattering 

of B's. Is eager to learn and has 
ability to synthesize material learned 
in different classes. 



Extracurricular: Dramatics 

Future Teachers of America 
Cheee Leader 
Yearbook Staff 
Class Activities 



Miscellaneous: Student has a genuine like for people and tries hard 

to make friends. Peers sometimes shy away because 
they feel keenly this student's native ability to 
be much above theirs. 
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Appendix D 

Multflple Regression Analyses 
for Six^VTeek Harking: Periods 
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A special multiple regression analysis was performed on the 
data of five teachers selected from each school. The purpose 
of this analysis was to determine the relative weight carried 
by different types of data in the determination of six-week 
marks* The six-week marks for each marking period during each 
semester were predicted from all other data collected from the 
record book for the six-week period. The predictors in most 
instances were three quiz or daily work grades, a six-week daily 
average grade, and a six-week test grade. The results are shown 
in Table D 1, 

Each row of the table represents a six-week period with 
first semester data on the left and second semester on the right. 
The percents of variance accoimted for by the three quiz or daily 
marks are given in the columns headed 1, Q 2, and Q 3'»; the 
percent attributable to daily average under the column headed 
"DA”? and the percent -attributable to the six-week test in the 
column labeled ”6 VjT”. A dash indicates that a teacher did not 
record marks for a specific predictor score. 

Where all five predictors are available, the total percent 
of variance accounted for is consistently high for most teachers. 
This implies that the predictor variables used in most analyses 
represent the important factors upon uhich teachers based their 
six-week marks. Of course, this is to be expected because the 
daily average and six-week test are included in the predictor 
variables. The exceptions are Teachers Uj. (second sek^sester), 

31 (second semester), and 46 (both semesters). There is no appar- 
ent explanation for these low values so it seems appropriate to 
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conclude that the s5jc-week marks In these cases ere based to a 
substantial degree upon subjective judgments unrelated to data 
..‘recorded by the teacher* 
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Table D 1 



Percent of Variance in Slji'.Weeks 
ISarks Attributable to Quiz, Daily 
Average » and Six-Weeks Test Marks 



First Semester 



I.D* 

No. 


b 

Wks 


. Q1 


02 


03 


m 


6 

WT 


"ToT 

tal 


Q1 




1 


-14 


07 


13 


32 


59 


97 


6 


k 


2 


- 2 


1 


9 


56 


32 


96 


- 1 




3 


1 


- 4 


- 3 


61 


42 


97 


0 


8 


1 


5 


10 


- 2 




78 


91 


X 


2 


- 4 


3 


4 


31 


62 


96 


3 




3 


0 


40 


0 


«»«■ 


— 


40 


0 


11 


1 


19 


7 


16 


23 


31 


96 


» 3 - 


2 


17 


7 


28 


2 


40 


94 


6 




3 


6 


11 


- 5 


34 


43 


89 


-13 - 


- 


1 


- S 


- § 


2 


98 


9 


99 


2 


12 


2 


- 1 


5 


0 


54 


37 


95 


. 5 - 




3 


• 5 


3 


- 3 


69 


28 


93 


3 


14 


1 


- 2 


1 


- 2 


62 


40 


99 


-11 


2 


2 


- 3 


- 9 


63 


45 


98 


0 - 


• . t 


3 


16 


7 


29 


- 6 


37 


83 


9 


31 


1 


15 


14 


8 


•mmrn 


56 


93 


1 


2 


7 


16 


3 


«»•» 


65 


91 


27 : 




3 


4 


45 


36 


mm 


m 


85 


19 : 


32 


-1 


3 


2 


1 


39 


53 


98 


- 1 - 


2 


- 2 


3 


2 


48 


47 


98 


- 3 - 




3 


56 


18 


2 




mm 


76 


- 2 


39 


1 


0 


0 


0 


300 


0 


300 


0 


2 


0 


0 


0 


300 


0 


300 


0 




3 


0 


0 


0 


300 


0 


K)0 


0 


45, 


1 


-10 - 2 • 


-30 


51 


88 


97 


12 


2 

3 


-i? 


5-3 


86 


23 


94 


7 - 




3 • 


• 5 


10 


58 


31 


97 


• 1 < 1 . 


46 


1 


0 


1 


0 




37 


** 

72 


11 1 


2 


2 


6-1 


54 


6 


69 






3 


1 


7 


45 


16 


3 


72 


40 









t> To- 



8 2 46 33 97 



0 0 100 0 100 



1 

0 

0 



0 35 64 99 
0 22 74 99 

0 0 ID O 100 



n - 



7 16 56 
1 62 21 
1 n .0 — 



73 

99 

97 



8 



6 56 22 94 
3 58 44 99 

7 87 — 98 



8 



5 55 -11 62 
0 52 38 89 
2 28 33 80 



37 25 72 
75 -34 76 
— 22 81 



7 
1 

8 



2 59 43 92 
2 57 45 96 
4 55 — 65 



0 

0 

6 



0 0 100 100 
0 ~ 100 JDO 

w- .. 6 



8 



-“ 66 13 
8 79 8 99 

— 57 47 95 



S 



10 40 30 89 
6 — 54 
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One hi^ly unusual outcome is that :Tor the third six-weeks 
of the second semester for Teacher 11. The daily average accounts 
for more than 100 percent because it correlates .98 with the 
criterion and its beta weight exceeds 1.00 • Two of the quizzes 
have negative beta weights sc the total varxcuice accounted for is 
less than 100 percent. 

There are several instances where one predictor accounts for 
all of the variance in six-week marks » viz* third six-weeks of 
second semester for Teachers and 8 and all periods except third 
six-weeks of second semester for Teacher 39. The predictor which 
correlates perfectly with marks is either daily average or the 
six-week test. Therefore » the teacher simply used the daily 
average (or the six-week test) grade as the grade for the six- 
week period despite the fact that quiz and six-week test grades 
’ (or quiz and daily average grades) were available. At the other 

I , 

extreme « we find that the ;aarks for the third six-weeks of semes- 
ter one for Teacher 8 and the thixv. six-weeks of semester two 
for TeacheV 39 caxmot be accounted for to any appreciable extent. 
Neither dally average nor six-week . test marks had been recorded 
and only one of the available quiz mai*ks accounts for any 
variance. It is In^ossible to say what the teacher based six- 
week marks upon under these circumstances unless it was subjective 
Judgment. 

The six-week test and daily average « when recorded* account 
for more variance; than the quizzes for most teachers. However* 
there appears to be no consistency in the relative importance of 
the quizzes* dally average* and test for a given ti^acher over 
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different aix>week periods. This reflects differences In the 

magnitude of the predictor and criterion variances and Inter- 

correlatlons from one period to the next. Also, since most 

teachers reported that they do not use a fomala In asslgalng 

marks (see Appendix B) a fair amount of subjective Judgment 

undoubtedly affects the weights carried by the various predictors 

The systematic use of 8lB5)le weighting formulas would tend to 

stabilise the relative lB 5 >ortance of the predictors and would 

also give both the teachers and students a better understanding 
of marks • 
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Appendix E 



Mean IQ and Correlations 
of IQ and Reported Marks 
for Individual Classes 
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TEST^GRADE CORRELATIONS 
First Semester 



91 



Teacher 1 
Otis 



Biology Mean IQ=107 



First 6 Wks. 




529 










Second 6 Wks 


t 


471 


895 


••• 






Third 6 Wks. 




473 


874 


859 


••• 




Sem. Ex. 




433 


831 


841 


817 


--- 


Sem. Mk. 




457 


924 


933 


939 


929 - 


Teacher 2 


S=2$ 


American Government 


Mean 


IQ-118 


ACT 














Otis 


910 


... 










First 6 Wks. 


669 


51*4 


••• 








Second 6 Wks 


. 733 


607 


640 


•••• 






Third 6 Wks. 


723 


496 


658 


658 






Sem. Ex. 


578 


449 


700 


723 


744 


— 


Sem. Mk. 


731 


543 


852 


805 


876 


878 - 


Teacher 3 


Bata not available 


• 






Teacher 1|. 


N=19 


Spanish II 


Hean IQ==llS 





Otis 



First 6 Wks. 




238 


... 








Second 6 VHcs 


• 


300 


662 








Third 6 Wka. 




036 


737 


741 






Sem. Ex. 




207 


815 


869 


844 


••• 


Sem. Mk. 




256 


915 


924 


894 


928 — 


Teacher 5 


less 


than l5 students with con^leto data. 


Teacher 6 


Less 


than l5 students with complete data. 


Teacher 7 


H*22 


English 


III 


Mean 


1^124 




Otis 




<sm w M 










First 6 I\Tfs. 




366 










Second 6 Wks. 


109 


k67 








Third 6 Wks. 




198 


615 


597 


... 




Sem. Ex. 




Uk6 


633 


481 


855 




Sem. Mk. 




389 


736 


683 


925 


887 


Teacher 6 


Ns24 


English 


IV 


Mean 


IQ-118 





ACT 

Otis 

First 6 Wks. 
Second 6 Vfks. 
Third 6 Wks. 
Sem. Ex. 

Bern. Mk« 



637 

1^05 

186 

252 

m 



215 

036 

177 



751 

790 

m 



578 





888 
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Teacher 9 N»l8 
Otis 



World History Mean IQ=106 



92 



m 



First 6 Wks. 
Second 6 \lkSc 
Third. 6 Wli:s . 


6ao 

6U7 

631 


924 

893 


926 






Sem. Ex. 


806 


803 


815 


901 


mmrnm 


Sem. Mk. 


671 


941 


967 


973 


909 


Teacher 10 N=l6 


Spanish I 


Mean 


TQ=116 




Otis 

First 6 Wks. 
Second 6 Wks. 
Third 6 Wks. 


30l|. 

216 

189 


774 

851 


814 


mmmm 




Sem. Ex. 


12l|. 


565 


781 


699 




Sem. Mk. 


234 


812 


836 


874 


785 



M 

V 

U 

% 

V 



jn 



Teacher 11 N=21 Biology Mean IQ=116 



Otis 

First 6 Wks. 
Second 6 Wks. 
Third 6 Wks. 


420 

372 

542 


867 

919 


86!{. 






Sem. Ex. 


491 


839 


909 


853 




Sem. Mk. 


494 


878 


927 


895 


945 — 


Teacher 12 M=26 


Latin 


II 


Mean IQ-121 




Otis 

First 6 Wks. 
Second 6 Wks. 


523 

481 


797 








Third 6*"Wks. 


638 


842 


9U|. 






Sem. Ex. 


674 


654 


733 


826 




Sem. Mk. 


603 


840 


922 


995 


837 •— 


Teacher 13 N=23 


Algebra I 


Mean 


1%=112 




Otis 

First 6 Wks. * 
Second. 6 Wks . 
Third 6 Wks. 


«» 

026 

018 

-281 


649 

480 


658 






Sem. Ex. 


039 


210 


515 


459 


... 


Sem. Mk. 


044 


589 


842 


821 


706 — 



> 



Teacher li|. N:=:2lt. English II Mean IQ-113 



Otis 

First 6 Wks. 
Second 6 Wks. 
Third 6 Wks. 
Sem. Ex. 

Sen. Mk. 



511 


mm 9m 




622 


786 


• •• 


497 

500 


i 


800 

844 


630 


858 


952 
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Teacher 15 N=s23 


Ali^ebra I 


Hean IQsl24 




Otis 




* • 








First 6 Wks. 


-040 


«««• 








Second 6 Wks* 


-219 


749 








Third 6 Wks . 


-170 


757 


830 






Sem« Kx* 


067 


330 


!l8^ 


649 




Sem. Mk* 


-117 


761 


975 


951 


762 


Teacher 16 N=25 


Sociology 


Dean 


1(^116 




ACT 












Otis 606 












First 6 Wks. 1|.95 


iti^e 










Second 6 Wks. I|.56 


32k 


650 


'mmmm 




■ t 


Third 6 VAcs. 324 


077 


538 


753 






Sem* Ex* 521 


515 


820 


645 


438 


••• 


Sem* !4k. 552 


437 


852 


900 


784 


838 


Teacher 17 N=26 


American History 


Mean IQ-121 


Otis 












First 6 Wks, 


-164 










Second 6 Wks* 


082 


533 








Third 6 Wks . 


153 


038 


312 






Sem* Ex* 


-031 


• 162 


260 


571 


«»«€• 


Sem* Mk. 


-034 


091 


494 


767 


879 



93 



Teacher 16 Less than 1 $ . students with complete data . 



Teacher 19 


N»28 


Algebra II 


Mean IC^112 


Otis 












First 6 Wks. 




171 


mm mm 






Second 6 Wks 


• 


253 


779 






Third 6 Wks. 




156 


701 


652 




Sem. Ex. 


■ ■' 


135 


633 


599 


566 — 


Sem. Mk*. 

•-> 




230 


881 


866 


831 827 


Teacher 20 


N«23 


Biology Mean IQ-IOS 


Otis 




mrn^ 








First 6 Wks* 




631 








Second 6 W!is 


e 


532 


700 






Third 6 Wks* 




735 


825 


789 


mmm 


Sem. Ex. 


*» 


556 


628 


743 


646 — •*• 


Sem* Mk. 




654 


860 


927 


894 853 


Teacher 21 


Data 


not available. 










m *t-y »siP-T»r>yr 















aM >y a a gy ti i», 






i 



!*P^ 






Teachar 30 N=19 Advanced Math Mean 1Q=1X9 



% 



Otis 

Plrat 6 Wks. 
Second 6 Wks . 
Third 6 Wks. 
Sem. Ek. 

Sem. Hk. 



Teacher 31 N— 2lf, Unified Oeoioetry Mean IQ— 107 



Otis 

First 6 Wks . 
Second 6 Wits. 
Third 6 Wks. 
Sen. Ex. 

Sen. Mk. 



5a 

597 

660 

550 

626 



7k6 

552 

813 



8U1 

636 

908 



6a — 

910 778 



Teacher 32 N=23 Biology Mean IQ=109 



Otis 

First 6' Wks. 
Second 6 Wks. 
Third 6 Wks. 
Sem. Ex.' 

Sem. Mk. 



528 

563 

597 

676 

661 



877 

776 

839 

921 



881 — 
829 816 

%6 885 



920 



Tanew Students with conmiete data. 

3h Less than 15 students with conmiete data. 

Teacher 35 N*2!|. 

Otis 

First 6 Wks. 

Second 6 Wks. 

Third 6 Wks. 

Sem. Ex. 

Sem. JMk. 



Teacher 36 N*30 World Geography Mean IQ=lo6 

Otis 

First 6 Wks. 

Second 6 Wks. 

Third 6 Wks. 

leS! 10 ggj 



Biology Mean IQ=10t» 


611 








1^96 


565 






528 


723 


755 




581 


l|.08 


638 


8o8 


627 


667 


833 


951 



588 


««« 




502 


80k 




U07 


653 


709 


731 


2*^5 


576 


665 


823 


782 









ERIC 



¥ 

m 



085 








- g 


348 


781 


««« 






261 


782 


766 






217 


710 


742 


672 ' — 


.■iv' 


239 


849 


857 


853 923 — 


•v> 






I 



Jv 

I 









i 

i 



: i 






Taacher 37 N=21 Sociology Mean IQ-105 



95 



Otis 

First 6 V/ks. 
Second 6 Wks 
‘Phird 6 VACS. 
Sem. Ex. 

Sen. Mk. 



428 






233 


661 


e 


010 


-778 


781 


367 


666 


810 


261 


919 


885 



84k 

916 



953 



Teacher 33 H^iT World History Mean IQ=105 



Otis 

First 6 Wks. 
Second 6 VAcs. 
Third 6 Wks. 
Sem. Ex. 

Sen. Mk. 



Teacher 39 ^-21 



Otis 

First 6 Wks. 
Second 6 Wks. 
Third 6 Wks. 
Sem. Ex. 

Sem. Mk. 



cvx 

370 


519 








219 


665 


531 


... 




419 


766 


652 


698 




352 


689 


711 


365 


911 


American History 


Mean 


IQ=113 


222 










141 


U58 


.... 






137 


6k7 


793 


••• 




271 


m 


716 


699 




289 


597 


853 


925 


824 



Teacher 40 N=20 Algebra 1 Mean IQ=101 



Otis 

First 6 Wk.3* 
Second 6 Wks. 
Third 6 Wks, 
Sem. Ex. 

Sem. Mk. 



579 


. ••• 






699 


742 


••• 




636 


766 


882 


••• 


610 


729 


787 


807 — 


662 


828 


933 


948 912 



Teacher 41 
Teacher 4^ 
Teacher 43 



Data not available. 

Data- not available. 

Less than 15 students with conflate data< 



Teacher 45 Ks21 
Otis 



Spanish. I Mean IQ«117 



First 6 Wks. 


262 








Second 6 Wks . 


370 


770 


»•»«» 


• 


Third 6 Wks. 


269 


763 


900 




Sem. Ex. 


325 


735 


747 


844 


Sem. Mk. 


. 362 


840 


692 


935 934 






O 

ERIC 















v-i-awA^w r<. ^ J<r -y ,. 






Teacher i(6 Jfs25 ^llah II Mean 1(^10? 



96 



Otis 

First 6 Wks. 
Second 6 vnte. 
Third 6 Vks. 
Sem. Ex. 

Sem. Me. 



385 

527 

397 

267 

322 



773 

796 

666 

943 



623 

422 

767 



459 

771 



702 



Teacher 47 tees then 15 students with eonplete data. 



Teacher 48 H*22 tatin 1 Mean 1<1»^^H2 



Otis 

First 6 Mts. 
Second 6 Vlfcs. 
Third 6 UkSi 
Sen. Ex. 

Sen. Mk. 



424 

383 

467 

411 

493 



915 — 




678 



722 

705 

898 



768 — 

895 871 



' ' "":■ 

ERIC 






I 



>S 



ft? 






I- 

I 



€ 






% 

I 



I 



% 

V7, 



III. i.i w. wij,i B p, uia i ^ 



F 



«-k.. ^ 






1 

I 1 



TSST-GHADB C0BRBZ«AT10NS 
Second Semester 



97 



Teacher 1 Ns3i|. 


Biology 


Mean IQ=107 




Otis 


mmmm 










First 6 Wks . 


5031 


... 








Second 6 Wks. 


429 


771 








Third 6 Wks. 


436 


629 


853 






Sem. Ex. 


382 


661 


587 


666 


mmm^ 


Sem. Hk. 


422 


680 


791 


860 


663 


Teacher 2 Data not available. 


i 






Teacher 3 N=21 


English 


I 


Mean IQ«lll|. 




Otis 












First 6 VJks. 


iSi 










Second 6 Wks. 


221 


1^93 


•»«« 




• 


Third 6 Wks. 


-o5i 


502 


416 


... 




Sen. Ex. 


006 


559 


441)' 


722 




Sets. Mk. 


066 


68t|. 


662 


829 


916 


Teacher l|. N=19 


Spanish 


II 


Mean 


IQ=ll5 




Otis 


m 










First 6 Wks. 


197 


mmm 








Second 6 Wks. 


171 


659 








Third 6 Wlcs. 


-Itl 


595 


620 






Sem. Ex. 


072 


789 


621 


706 




Sem. Mk. 


079 


783 


774 


867 


908 



Teacher S Less than IS students with eotsplete data. 

Teacher 6 Less than IS students with con^lete data. 



Teacher 7 


K«23 


English 


III 


MSan IQ=124 


Otis 




m^m 








First 6 Wks. 




112 


««« 






Second 6 Wks 


• 


069 


73U 






Third 6 Wks. 




172 


306 


228 




Sem. Ex. 




134 


3hS 


352 


664 


Sem. Mk. 




155 


S7U 


501 


876 


Teacher 8 


Hs2t|. 


English 


IV 


Msan 


1Q.=118 


ACT 


mmm 










Otis 


637 










First 6 Wks. 


332 


097 


... 






Second 6 Wks 


. 445 


197 


805 


««« 




Third 6 Wks. 


271 


156 


709 


913 




Sem. Ex. 




375 


24 


786 


746 


Sem. Hk. 


457 


305 


606 


905 


925 






O 

ERIC 









World History 



Mean XQsX06 



98 



Teacher 9 



N~16 



Otis 

First 6 Wks. 
Second 6 Wks • 
Third 6 Wks. 
Sen. Ex. 

Sem. Mk. 



863 — 

870 893 — 

8li8 925 9U7 — 

7SU 797 887 817 — 

675 929 980 966 930 — 



Teacher 10 less than 15 students with coB?>1.9te data. 



Teacher 11 N=30 Blclogy . llean IQ=116 



Otis 

First 6 Wks. 
Second 6 Wks. 
Third 6 Wks. 
Sem. Exe 
Sem. Mk. 


319 
, 378 
224 
539 
397 


700 

686, 

654 

711 


768 

602 

793 


822 

926 


938 — 


Teacher 12 N»26 


Latin 


II 


Mean IQ=I2l 




Otis 

First 6 Wks. 
Second 6 Wks. 
Third 6 Wks. 
Sem. Ex. 

Sem. Mk. 


522 

524 

463 

533 

569 


818 

810 

767 

879 


753 

809 

868 


826 

891^ 


944 — 


Teacher 13 Data not available. 






Teacher llj. N=23 


English II 


Mean 


1^=112 




Otis 

First 6 Wks. 
Second 6 Wks. 
Third 6 Wks . 
Sem. Ex. 

Sem. Mk. 


597 

747 

678 

705 

756 


690 

585 
662 . 
733 


' 820 

8i|.8 

869 


709 

907 


891 — 


Teacher 15 N»2l4. 


Algebra I 


Mean IQ«123 




Otis 

First 6 Wka. 
Second 6 Wks. 
Third 6 Wks. 
Sem. Ex. 

Sem. Mke 


050 

o5o 

•124 

•086 

-029 


928 

768 

832 

921 


841 

841 

972 


807 

911 


899 — 


Teacher 16 Data not available. 
























Teacher 1? Ns2lj. American History liean IQ-121 



99 



Otis 

First 6 Wks. 
Second 6 Viks. 
Third 6 Wks. 
Sent. Ex. 

Sen. Mk. 



253 

151|. 

037 

•099 

•X32 



It71 

223 

566 

634 



045 

503 



154 — 

661 620 



Teacher l8 ' Iiess than 15 students with conq^lete data. 

Teacher 19 N=28 Algebra It ' Mean 1^113 

Otis 

First 6 Wks. 

Second 6 Wks. 

Third 6 Wks. 

Sem. Ex. 

Sen. Mk. 

Teacher 20 N=26 Biology Mean IQ=107 



254 








166 


677 






271 


700 


708 




249 


648 


692 


516 


239 


878 


892 


805 



Otis 

First 6 Wks. 
Second 6 Wks. 
Third 6 Wks. 
Sem. Ex. 

Seim. Mk. 



595 

510 

546 

573 

645 



750 

676 

807 

890 



600 

907 

879 



2 ^ 

820 



940 



Teacher 21 Data not available. 



Teacher 30 N=20 Advanced Math' Mean IQsll9 

Otis *•.. 

First 6 Wks. 

Second 6 Wks .; 

Third 6 Wks. 

Sem. Ex. 

Sem. Mk. 



107 


• •• 






754 




359 


664 


759 


253 


595 


597 


306 


863 


891 



703 

690 827 



Teacher 31 Less than 15 students with conplete data< 

Teacher 32 Ns25 Biology Mean IQ=109 

Otis : 

First 6 Wks. 

Second 6 Wks. 

Third 6 Wks . 

Sem. Ex. 

Sem. Mk. 



1+27 








319 


795 


ease 




326 


780 


771 




385 


679 


746 


741 — 


439 


861|. 


913 


890 866 



er|c 













- — r 



I 



4 

iS 



100 



Teacher 33 
Teacher 32)^ 



Iiess than l5 students with complete data. 
Less than 15 students with oonqplete data. 



Teacher 35 N-23 Biology Mean IQ=10l|. 



Otis 












First 6 vncs. 


509 


• •• 








Second 6 Wks. 


ikZ 


656 








Third 6 VIks. 


553 


616 


953 


«» W W 




Sem. lx. 


627 


726 


749 


734 


... 


Sem. Mlf. 


615 


838 


806 


807 


845 


Teacher 36 Data not available 


• 






Teacher 37 N=20 


Sociology 


Mean 


14=105 




Otis 


mmr m 










First 6 Wks. 


316 










Second 6 Wks. 


292 


799 








Third 6 Wks. 


299 


877 


650 


»»» 




Sem. Ex. 


koS 


741 


713 


603 




Sem» Mk. 


4o6 


919 


859 


845 


874 


Teacher 36 N^ld 


World 


History Mean IQ=106 


Otis 


•» «p* 








• 


First 6 Wks. 


554 










Second 6 Wks. 


495 


769 








Third 6 Wks. 


577 


721 


676 


m 




Sem. Ex. 


573 


687 


710 


546 




Sem. Mk. 


647 


908 


857 


769 


880 


Teacher 39 N«20 


American History 


Mean IQ-112 


Otis 












First 6 Wks. 


165 










Second 6 Wks. 


276 


772 








Third 6 Wks . 


239 


882 


835 






Sem. Ex. 




860 


594 


679 




Sem. Mk. 


156 


930 


774 


858 


915 


Teacher i|.0 Nsl9 


Algebra I 


Ifeen IQ^lOl 




Otis 


mmmm 










First 6 Wks. 


141-3 


«»*•» 








Second 6 Wks. 


1^95 


818 


mmmmm 






Third 6 Wks. 


528 


864 


938 


m^m 




Sem. Ex. 


388 


890 


830 


923 




Sem. Mk. 


502 


917 


957 


979 


91(4 



o 

ERIC 



t 









I 

» 

# 









^ li* I lY ai. 1 









/ 

t 



I 






O 

,ERIC 



Teacher l|.l Less than 15 students with complete data. 
Teacher lf.2 Nsl6 American History Mean IQ^IOG 
Otis 

First 6 Wks. 

Second 6 Wks. 

Third 6 Wks. 

Sem* Exs 
Sem. Mk. 



101 



510 


• •• 




375 


171 




369 


457 


-013 


Ol.l 

■hVj A 


495 

761 


. ^ O ^ 
-iO^ 

080 


507 



fyo 

620 



875 



Teacher 43 less than 15 students with complete data. 

Teacher 45 N*23 Spanish. I Mean IQ=117 

Otis 

First 6 Wks. 

Second 6 Wks. 

Third 6 Wks. 

Sem. Ex. 

Sem. Mk. 



342 






267 


904 




350 


850 


877 


368 


811 


831 


351 


870 


899 


English II 


Mean 




220 


• •• 




221 


344 




230 


750 


547 


170 


678 


335 


287 


767 


566 



936 — 

985 954 



Teacher 46 N=22 

Otis 

First 6 Wks. 
Second 6 VAcs. 
Third 6 Wks. 

Sem. Ex. 

Sem. Mk. 



Teacher 47 less than l5 students with conq;>lete data. 

Teacher 48 H=23 Latin I Mean 1^1X2 

Otla 

First 6 Wks. 

Second 6 Wks. 

Third 6 Wks. 

Sem. Ex. 

Sem. Mk. 



470 

576 

515 

473 

559 



908 

856 

865 

956 



820 — 
824 670 

956 899 



868 


















